-- Logs begin at Tue 2022-09-06 09:50:21 UTC, end at Tue 2022-09-06 12:36:12 UTC. --
Sep 06 10:40:50.427315 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Sep 06 10:40:53.737153 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=133652) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}}
Sep 06 10:40:53.738101 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=133652) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}}
Sep 06 10:40:53.738101 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=133652) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}}
Sep 06 10:40:54.163615 ncdv-master-1 cinder-volume[133652]: INFO dbcounter [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Registered counter for database cinder
Sep 06 10:40:54.182719 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_db.sqlalchemy.engines [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Sep 06 10:40:54.189423 ncdv-master-1 cinder-volume[133652]: DEBUG dbcounter [-] [133652] Writer thread running {{(pid=133652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Sep 06 10:40:54.485707 ncdv-master-1 cinder-volume[133652]: INFO cinder.rpc [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 06 10:40:54.490665 ncdv-master-1 cinder-volume[133652]: INFO cinder.rpc [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 06 10:40:54.500033 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_db.sqlalchemy.engines [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Sep 06 10:40:54.570593 ncdv-master-1 cinder-volume[133652]: INFO cinder.volume.manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Determined volume DB was empty at startup.
Sep 06 10:40:54.574918 ncdv-master-1 cinder-volume[133652]: DEBUG cinder.volume.manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=133652) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Sep 06 10:40:54.581909 ncdv-master-1 cinder-volume[133652]: INFO cinder.volume.manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 06 10:40:54.582842 ncdv-master-1 cinder-volume[133652]: WARNING stevedore.named [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 10:40:54.583734 ncdv-master-1 cinder-volume[133652]: WARNING castellan.key_manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 10:40:54.584929 ncdv-master-1 cinder-volume[133652]: WARNING cinder.keymgr.conf_key_mgr [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 10:40:54.603043 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_db.sqlalchemy.engines [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Sep 06 10:40:54.608125 ncdv-master-1 cinder-volume[133652]: INFO cinder.rpc [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 06 10:40:54.612940 ncdv-master-1 cinder-volume[133652]: INFO cinder.rpc [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Sep 06 10:40:54.613858 ncdv-master-1 cinder-volume[133652]: WARNING stevedore.named [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 10:40:54.614488 ncdv-master-1 cinder-volume[133652]: WARNING castellan.key_manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 10:40:54.616673 ncdv-master-1 cinder-volume[133652]: INFO cinder.volume.manager [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Sep 06 10:40:54.622692 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_db.sqlalchemy.engines [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Sep 06 10:40:54.730132 ncdv-master-1 cinder-volume[133652]: INFO oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Starting 1 workers
Sep 06 10:40:54.735751 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Started child 133823 {{(pid=133652) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Sep 06 10:40:54.737195 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Full set of CONF: {{(pid=133652) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Sep 06 10:40:54.737615 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ******************************************************************************** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Sep 06 10:40:54.738382 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] Configuration options gathered from: {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Sep 06 10:40:54.738382 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Sep 06 10:40:54.739055 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Sep 06 10:40:54.739338 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ================================================================================ {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Sep 06 10:40:54.740109 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] allow_availability_zone_fallback = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.740636 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] allow_compression_on_image_upload = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.741290 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] allowed_direct_url_schemes     = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.741720 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] api_rate_limit                 = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.742217 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] auth_strategy                  = keystone {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.742653 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] az_cache_duration              = 3600 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.743115 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_availability_zone      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.743519 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_host                   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.743905 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_name                   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.744342 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_stats_polling_interval = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.744704 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backup_api_class               = cinder.backup.api.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.745097 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.745530 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backup_name_template           = backup-%s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.745935 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backup_use_same_host           = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.746841 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backup_use_temp_snapshot       = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.747284 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] chap_password                  = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.747875 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] chap_username                  =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.748095 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.748542 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_internal_tenant_project_id = bd4e815d95a246d5ab51c3c2719e5df8 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.748950 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_internal_tenant_user_id = c06e2a3faa864da19cef4089e8392702 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.749312 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cloned_volume_same_az          = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.749740 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cluster                        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.750138 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] compression_format             = gzip {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.757286 ncdv-master-1 cinder-volume[133823]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Sep 06 10:40:54.763417 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] compute_api_class              = cinder.compute.nova.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.764246 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] config_dir                     = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.764844 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.765442 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] config_source                  = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.766012 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.766729 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] control_exchange               = openstack {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.767444 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] debug                          = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.768063 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] default_availability_zone      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.768626 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] default_group_type             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.769793 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.770677 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] default_volume_type            = ceph {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.771736 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_client_cert             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.772330 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_client_cert_key         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.772978 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_data_namespace          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.773602 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_ssl_cert_path           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.774267 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_ssl_cert_verify         = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.774911 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] driver_use_ssl                 = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.775472 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] enable_force_upload            = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.775948 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] enable_new_services            = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.776458 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] enable_unsupported_driver      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.777058 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] enabled_backends               = ['ceph'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.777642 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] enforce_multipath_for_image_xfer = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.778140 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] filter_function                = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.778647 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_api_insecure            = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.779321 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_api_servers             = ['http://10.222.0.20/image'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.780108 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_api_ssl_compression     = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.780810 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_ca_certificates_file    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.781778 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_catalog_info            = image:glance:publicURL {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.782283 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_certfile                = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.783072 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.783743 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_keyfile                 = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.784259 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_num_retries             = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.784792 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] glance_request_timeout         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.785328 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] goodness_function              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.785930 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] graceful_shutdown_timeout      = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.786448 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] group_api_class                = cinder.group.api.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.786899 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] host                           = ncdv-master-1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.787463 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.788069 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_compress_on_upload       = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.788661 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_conversion_address_space_limit = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.790378 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_conversion_cpu_limit     = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.791124 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.792056 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_conversion_disable       = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.792583 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_upload_use_cinder_backend = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.793267 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_upload_use_internal_tenant = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.793909 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_volume_cache_enabled     = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.794284 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Starting volume driver RBDDriver (1.2.0)
Sep 06 10:40:54.794597 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_volume_cache_max_count   = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.795204 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] image_volume_cache_max_size_gb = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.795702 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] init_host_max_objects_retrieval = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.795966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:54.796447 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] instance_format                = [instance: %(uuid)s]  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.796962 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.797522 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iscsi_iotype                   = fileio {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.798106 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iscsi_secondary_ip_addresses   = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.798630 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iscsi_target_flags             =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.799197 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iscsi_write_cache              = on {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.799822 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iser_helper                    = tgtadm {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.801106 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iser_ip_address                = 10.222.0.20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.802077 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iser_port                      = 3260 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.802614 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.803179 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_config_append              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.803919 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.804424 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_dir                        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.805045 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_file                       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.805415 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_options                    = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.805832 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_rotate_interval            = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.806241 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_rotate_interval_type       = days {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.806616 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] log_rotation_type              = none {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.806918 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.807266 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.807641 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.808001 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.808293 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.809201 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] max_age                        = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.809588 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] max_logfile_count              = 30 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.810030 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] max_logfile_size_mb            = 200 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.810645 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] max_over_subscription_ratio    = 20.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.811137 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] message_reap_interval          = 86400 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.811668 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] message_ttl                    = 2592000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.812354 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] migration_create_volume_timeout_secs = 300 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.812774 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] monkey_patch                   = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.813138 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] monkey_patch_modules           = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.813780 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] my_ip                          = 10.222.0.20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.814141 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] no_snapshot_gb_quota           = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.814495 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] num_iser_scan_tries            = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.814894 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] num_shell_tries                = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.815359 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] num_volume_device_scan_tries   = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.815990 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] nvmet_ns_id                    = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.816360 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] nvmet_port_id                  = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.816767 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_max_limit                = 1000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.817136 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_ext_list          = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.817609 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.817986 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.818364 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_listen_port       = 8776 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.818717 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_use_ssl           = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.819118 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] osapi_volume_workers           = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.819491 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] per_volume_size_limit          = -1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.819839 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] periodic_fuzzy_delay           = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.820211 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] periodic_interval              = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.820740 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.821085 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] public_endpoint                = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.821435 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] publish_errors                 = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.821782 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_backup_gigabytes         = 1000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.822423 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_backups                  = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.822810 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_consistencygroups        = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.823211 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.823886 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_gigabytes                = 1000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.824243 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_groups                   = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.825245 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_snapshots                = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.825698 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] quota_volumes                  = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.826292 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] rate_limit_burst               = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.826661 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] rate_limit_except_level        = CRITICAL {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.827032 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] rate_limit_interval            = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.827398 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] reinit_driver_count            = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.827757 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] replication_device             = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.828109 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] report_discard_supported       = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.828464 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] report_interval                = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.828976 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] reservation_clean_interval     = 86400 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.829274 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] reservation_expire             = 86400 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.829645 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] reserved_percentage            = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.830023 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.830404 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.830926 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] rpc_response_timeout           = 120 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.831486 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] run_external_periodic_tasks    = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.831852 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.832360 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] scst_target_driver             = iscsi {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.832737 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] scst_target_iqn_name           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.833026 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_down_time              = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.833403 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] snapshot_name_template         = snapshot-%s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.833852 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] snapshot_same_host             = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.834300 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] split_loggers                  = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.834599 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] state_path                     = /opt/stack/data/cinder {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.834957 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] storage_availability_zone      = nova {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.835369 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] storage_protocol               = iSCSI {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.836916 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] syslog_log_facility            = LOG_USER {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.837723 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] target_helper                  = lioadm {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.838684 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] target_ip_address              = 10.222.0.20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.839097 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] target_port                    = 3260 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.839491 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.839885 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] target_protocol                = iscsi {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.840340 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] trace_flags                    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.840741 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.841130 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] transport_url                  = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.841523 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] until_refresh                  = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.841894 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_chap_auth                  = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.843770 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_default_quota_class        = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.844400 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_eventlog                   = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.844896 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_journal                    = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.845374 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_json                       = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.845856 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_multipath_for_image_xfer   = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.846413 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_stderr                     = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.846879 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] use_syslog                     = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.847587 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] verify_glance_signatures       = enabled {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.848307 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_api_class               = cinder.volume.api.API {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.848900 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_backend_name            = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.850810 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_clear                   = zero {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.851425 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_clear_ionice            = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.851998 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_clear_size              = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.852474 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.852999 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_copy_bps_limit          = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.853472 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_dd_blocksize            = 1M {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.853928 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.854503 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_name_template           = volume-%s {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.854935 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_service_inithost_offload = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.855952 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volume_usage_audit_period      = month {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.856715 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.857290 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] watch_log_file                 = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.857887 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] zoning_mode                    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Sep 06 10:40:54.858511 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.858992 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.859499 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_concurrency.disable_process_locking = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.859957 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.860489 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.860926 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.861370 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.861842 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.862868 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.863546 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.admin_password = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.864000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:54.864413 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.864934 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.admin_token = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.865447 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.admin_user  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.865981 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.866612 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.867205 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_port   = 35357 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.867770 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_protocol = https {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.868340 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_section = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.868992 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_type   = password {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.869518 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_uri    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.870032 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.auth_version = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.870607 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.cache       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.872258 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.872979 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.certfile    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.873491 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.delay_auth_decision = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.874083 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.874742 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.http_connect_timeout = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.875290 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.875803 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.identity_uri = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.876744 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.include_service_catalog = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.880406 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.insecure    = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.880406 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.interface   = public {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.880406 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.keyfile     = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.881142 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.881622 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.882218 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.882713 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.883222 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.883877 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.884633 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.885199 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.885742 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.886242 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.region_name = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.886764 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.893842 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.service_token_roles_required = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.894226 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.service_type = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.894658 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.token_cache_time = 300 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.895080 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.895549 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.backend                  = dogpile.cache.null {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.895974 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.backend_argument         = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.896592 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.config_prefix            = cache.oslo {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.897220 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.dead_timeout             = 60.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.897611 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.debug_cache_backend      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.897983 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.enable_retry_client      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.898357 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.enable_socket_keepalive  = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.898720 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.enabled                  = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.899152 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.expiration_time          = 600 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.899518 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.hashclient_retry_attempts = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.900026 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.900415 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_dead_retry      = 300 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.900814 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_password        =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.901209 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.901572 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.901934 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_pool_maxsize    = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.902316 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.902712 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_sasl_enabled    = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.903248 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.908158 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.908924 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.memcache_username        =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.909501 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.proxies                  = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.910067 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.retry_attempts           = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.910613 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.retry_delay              = 0.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.911896 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.socket_keepalive_count   = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.912420 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.socket_keepalive_idle    = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.912939 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.socket_keepalive_interval = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.914230 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.tls_allowed_ciphers      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.914781 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.tls_cafile               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.915325 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.tls_certfile             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.915867 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.tls_enabled              = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.917283 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cache.tls_keyfile              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.917875 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] coordination.backend_url       = etcd3+http://10.222.0.20:2379 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.919168 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.backend               = sqlalchemy {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.919509 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.connection            = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.919937 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.connection_debug      = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.920332 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.connection_parameters =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.920723 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.connection_recycle_time = 3600 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.921091 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.connection_trace      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.921453 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.db_inc_retry_interval = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.921816 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.db_max_retries        = 20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.922173 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.db_max_retry_interval = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.922528 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.db_retry_interval     = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.922902 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.max_overflow          = 50 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.923287 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.max_pool_size         = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.923738 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.max_retries           = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.924271 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.mysql_enable_ndb      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.924642 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.925072 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.pool_timeout          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.925471 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.retry_interval        = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.925849 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.slave_connection      = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.926209 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.sqlite_synchronous    = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.926564 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] database.use_db_reconnect      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.926977 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.enforce_new_defaults = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.927588 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.enforce_scope      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.928151 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.policy_default_rule = default {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.928687 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.929259 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.policy_file        = policy.yaml {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.929809 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.930351 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.930866 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.931189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:54.931589 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.932116 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.932706 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.connection_string     = messaging:// {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.933249 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.enabled               = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.934457 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.es_doc_type           = notification {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.934998 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.es_scroll_size        = 10000 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.935570 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.es_scroll_time        = 2m {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.936098 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.filter_error_trace    = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.936615 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.hmac_keys             = SECRET_KEY {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.937128 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.sentinel_service_name = mymaster {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.937676 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.socket_timeout        = 0.1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.938197 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] profiler.trace_sqlalchemy      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.938743 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] os_brick.lock_path             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.939343 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.capabilities   = [21] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.939870 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.group          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.940396 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.helper_command = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.940919 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.941440 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.941981 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] privsep_osbrick.user           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.942536 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.943056 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.group         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.943551 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.helper_command = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.944081 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.944708 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.945216 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] cinder_sys_admin.user          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.945747 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.auth_section      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.946119 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.auth_type         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.946506 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.cafile            = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.946850 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.certfile          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.947272 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.collect_timing    = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.947721 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.insecure          = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.948077 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.keyfile           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.948459 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.send_service_user_token = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.948825 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.split_loggers     = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.949197 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] service_user.timeout           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.950193 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.backend_availability_zone = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.950554 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.950910 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.951311 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.chap_password = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.951678 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.chap_username =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.952043 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.952408 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.952869 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.953142 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_client_cert = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.953488 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_client_cert_key = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.953904 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_data_namespace = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.954260 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.954647 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.955003 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.driver_use_ssl = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.955378 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.enable_deferred_deletion = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.955731 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.enable_unsupported_driver = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.956335 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.957926 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.extra_capabilities = {} {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.958310 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.filter_function = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.958676 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.goodness_function = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.959202 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.959593 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.959956 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.960318 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.960680 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.961045 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.961428 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iscsi_iotype  = fileio {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.961795 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.962179 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iscsi_target_flags =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.962720 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iscsi_write_cache = on {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.963124 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iser_helper   = tgtadm {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.963689 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iser_ip_address = 10.222.0.20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.964059 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iser_port     = 3260 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.964428 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.964816 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.965220 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.965577 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.num_shell_tries = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.965932 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.966292 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.966653 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.nvmet_port_id = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.967055 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rados_connect_timeout = -1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.967417 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rados_connection_interval = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.967781 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rados_connection_retries = 3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.968177 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_ceph_conf =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.968552 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_cluster_name = ceph {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.968905 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.969281 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.969698 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.970016 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_pool      = rbd {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.970388 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_secret_uuid = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.970749 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.971330 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.rbd_user      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.971847 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.replication_connect_timeout = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.972359 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.replication_device = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.972720 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.report_discard_supported = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.973075 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.973430 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.reserved_percentage = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.973798 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.scst_target_driver = iscsi {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.974153 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.scst_target_iqn_name = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.974523 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.storage_protocol = iSCSI {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.974877 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.976507 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.target_helper = tgtadm {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.977025 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.target_ip_address = 10.222.0.20 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.977415 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.target_port   = 3260 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.977787 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.978177 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.target_protocol = iscsi {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.978538 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.trace_flags   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.978896 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.unique_fqdn_network = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.979829 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.use_chap_auth = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.980785 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.981420 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_backend_name = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.981801 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_clear  = zero {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.982532 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_clear_ionice = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.983164 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_clear_size = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.983690 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.984213 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.984748 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.985361 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.985798 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.driver [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Driver hasn't implemented _init_vendor_properties()
Sep 06 10:40:54.986309 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.986447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.driver [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:4daa98dc-5b12-4182-9225-fdb178ab05f0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133823) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Sep 06 10:40:54.987410 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_reports.file_event_handler = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.987977 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.988717 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_reports.log_dir           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.989792 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.backend_availability_zone = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.990646 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.backend_host              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.991527 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.backend_native_threads_pool_size = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.994101 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.backup_use_temp_snapshot  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:54.994669 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.chap_password             = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.000188 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.chap_username             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.000797 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.chiscsi_conf              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.001509 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.deferred_deletion_delay   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.002044 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.deferred_deletion_purge_interval = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.002571 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_client_cert        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.003118 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_client_cert_key    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.003692 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_data_namespace     = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.004203 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_ssl_cert_path      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.004727 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_ssl_cert_verify    = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.005249 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.driver_use_ssl            = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.005759 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.enable_deferred_deletion  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.006280 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.enable_unsupported_driver = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.006797 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.007357 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.extra_capabilities        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.007886 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.filter_function           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.008426 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.goodness_function         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.008954 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iet_conf                  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.009461 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.image_upload_use_cinder_backend = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.009978 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.image_upload_use_internal_tenant = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.010518 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.image_volume_cache_enabled = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.011358 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.image_volume_cache_max_count = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.012430 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.image_volume_cache_max_size_gb = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.012941 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iscsi_iotype              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.013470 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.013987 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iscsi_target_flags        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.014509 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iscsi_write_cache         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.015048 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iser_helper               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.015573 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iser_ip_address           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.016082 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iser_port                 = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.016606 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.iser_target_prefix        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.017128 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.max_over_subscription_ratio = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.017631 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.num_iser_scan_tries       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.018135 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.num_shell_tries           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.018638 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.num_volume_device_scan_tries = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.019243 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.nvmet_ns_id               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.019749 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.nvmet_port_id             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.020309 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rados_connect_timeout     = -1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.020830 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rados_connection_interval = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.021407 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rados_connection_retries  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.021918 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.022453 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_cluster_name          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.022964 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.023559 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.024073 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_max_clone_depth       = 5 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.024596 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_pool                  = volumes {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.025095 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_secret_uuid           = af92459c-afdf-43ef-b297-c68a15080ce7 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.025630 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_store_chunk_size      = 4 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.026137 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_db.sqlalchemy.engines [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Sep 06 10:40:55.026287 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.rbd_user                  = cinder {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.026772 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.replication_connect_timeout = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.027317 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.replication_device        = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.027859 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.report_discard_supported  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.028375 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.report_dynamic_total_capacity = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.028882 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.reserved_percentage       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.029387 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.scst_target_driver        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.030951 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writer thread running {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Sep 06 10:40:55.031205 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.scst_target_iqn_name      = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.031730 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.storage_protocol          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.032239 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.suppress_requests_ssl_warnings = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.032756 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.target_helper             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.033273 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.target_ip_address         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.033779 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.target_port               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.034296 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.target_prefix             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.034799 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.target_protocol           = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.035335 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.trace_flags               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.035851 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.unique_fqdn_network       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.036354 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.use_chap_auth             = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.036865 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.use_multipath_for_image_xfer = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.037404 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_backend_name       = ceph {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.037905 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_clear              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.038405 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_clear_ionice       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.038916 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_clear_size         = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.039492 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.040015 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_copy_bps_limit     = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.040516 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_dd_blocksize       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.041048 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.041547 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ceph.volumes_dir               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.042173 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.042712 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.043354 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.043719 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.044125 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.044486 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.044878 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.045244 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.045599 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.046140 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.046535 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.046907 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.047324 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.047726 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.048087 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.048473 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.048832 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.049195 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.049553 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.049910 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.050304 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.050630 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.051238 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.051863 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.052482 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.052927 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl      = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.053563 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.054154 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.054736 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.055343 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.055965 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.056521 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_notifications.driver = [] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.057135 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_notifications.retry = -1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.058147 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.059289 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] oslo_messaging_notifications.transport_url = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.059982 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.060513 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] key_manager.fixed_key          = **** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.061186 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.061776 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.barbican_api_version  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.062365 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.barbican_endpoint     = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.062971 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.barbican_endpoint_type = public {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.063582 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.barbican_region_name  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.064145 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.cafile                = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.064734 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.certfile              = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.065331 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.collect_timing        = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.065899 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.insecure              = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.066467 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.keyfile               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.067092 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.number_of_retries     = 60 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.067738 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.retry_delay           = 1 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.068341 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.send_service_user_token = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.068909 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.split_loggers         = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.069480 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.timeout               = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.070085 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.verify_ssl            = True {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.070419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.db.sqlalchemy.api [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Building query based on filter {{(pid=133823) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Sep 06 10:40:55.070896 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican.verify_ssl_path       = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.071761 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.auth_section = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.072339 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.auth_type = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.072900 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.cafile   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.073460 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.certfile = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.074024 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.collect_timing = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.075200 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.insecure = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.075781 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.keyfile  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.076373 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.split_loggers = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.076935 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] barbican_service_user.timeout  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.077535 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.approle_role_id          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.078125 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.approle_secret_id        = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.078702 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.cafile                   = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.079282 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.certfile                 = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.079850 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.collect_timing           = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.080425 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.insecure                 = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.080986 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.keyfile                  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.kv_mountpoint            = secret {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.kv_version               = 2 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.namespace                = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.root_token_id            = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.split_loggers            = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.ssl_ca_crt_file          = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.091064 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.timeout                  = None {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.092214 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.use_ssl                  = False {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.092214 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Sep 06 10:40:55.092214 ncdv-master-1 cinder-volume[133652]: DEBUG oslo_service.service [None req-437ed8bd-f0c1-4af3-82d6-3f57699e125b None None] ******************************************************************************** {{(pid=133652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Sep 06 10:40:55.094006 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=133823) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Sep 06 10:40:55.100405 ncdv-master-1 cinder-volume[133823]: INFO cinder.keymgr.migration [None req-3f5d61f6-f1dd-4cd9-852d-dbc7a0edb022 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 06 10:40:55.115470 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:55.149781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:55.185431 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:40:55.210995 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Driver initialization completed successfully.
Sep 06 10:40:55.211416 ncdv-master-1 cinder-volume[133823]: INFO cinder.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Initiating service 3 cleanup
Sep 06 10:40:55.226794 ncdv-master-1 cinder-volume[133823]: INFO cinder.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Service 3 cleanup completed.
Sep 06 10:40:55.226794 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.service [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Creating RPC server for service cinder-volume {{(pid=133823) start /opt/stack/cinder/cinder/service.py:238}}
Sep 06 10:40:55.232261 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.service [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=133823) start /opt/stack/cinder/cinder/service.py:244}}
Sep 06 10:40:55.283558 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Sep 06 10:40:55.284884 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:55.324383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:40:55.470847 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-99d7ff7f-0fdd-4f4d-81ab-668fa1271b71 None None] Driver post RPC initialization completed successfully.
Sep 06 10:41:04.634795 ncdv-master-1 cinder-volume[133652]: DEBUG dbcounter [-] [133652] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=133652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:41:05.400549 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=21,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:41:05.402597 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:41:45.476657 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:41:45.477331 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:42:05.474566 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:42:25.475485 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:42:45.482440 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:42:51.474215 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:42:51.475030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:42:51.500399 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:42:51.526903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:43:05.484143 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:43:25.488612 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:43:35.484265 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:43:51.472874 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:43:51.473520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:43:51.500758 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:43:51.525637 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:44:05.476622 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:44:15.475842 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:44:25.477621 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:44:35.484670 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:44:51.473541 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:44:51.474213 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:44:51.496006 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:44:51.519049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:45:05.490304 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:45:15.487766 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:45:35.488000 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:45:45.489707 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:45:51.473914 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:45:51.474603 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:45:51.496243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:45:51.518768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:46:15.488735 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:46:25.497130 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:46:45.500661 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:46:51.474408 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:46:51.475108 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:46:51.497436 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:46:51.519686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:47:05.506400 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:47:25.509494 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:47:35.517441 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:47:51.474927 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:47:51.476201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:47:51.499766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:47:51.523618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:47:55.510822 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:48:05.517514 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:48:15.523284 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:48:45.518611 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:48:51.478663 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:48:51.479377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:48:51.501473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:48:51.523572 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:48:55.515707 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:49:15.514782 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:49:25.515547 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:49:45.513587 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:49:51.478319 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:49:51.478992 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:49:51.502527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:49:51.627352 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:50:05.518833 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:50:05.519502 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:50:35.524344 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:50:51.483788 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:50:51.484475 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:50:51.590148 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:50:51.644108 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:50:55.520473 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:51:15.522494 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:51:35.527132 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:51:51.485153 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:51:51.485833 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:51:51.553978 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:51:51.710670 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:51:55.528427 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:51:55.529927 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:52:15.531757 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:52:35.531524 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:52:51.497606 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:52:51.498280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:52:51.576104 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:52:51.657592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:52:55.531515 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:53:05.551324 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:53:35.533467 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:53:45.530838 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:53:51.503098 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:53:51.505822 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:53:51.622078 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:53:51.716032 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:54:05.535973 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:54:25.538014 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:54:45.537853 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:54:46.815690 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:54:46.860851 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (03870dfc-5991-4087-bde9-67b654cbc849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:54:46.866643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213654a9-fa38-4c66-9c01-32a1963e5061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:46.917495 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213654a9-fa38-4c66-9c01-32a1963e5061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-355800598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a09ca45-0cf7-41bb-9c57-37de9f850cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437799e22df2433a83eca67987e942c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:54:47Z,use_quota=True,user_id='d9f88a4c72854cff9bba7ed2920f55b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:46.922391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7984d927-4351-4257-abd6-f0431e8164e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:46.926227 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7984d927-4351-4257-abd6-f0431e8164e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:46.931696 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd5e8f7-af6d-4e5e-b4b3-37fdac67265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:46.935645 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd5e8f7-af6d-4e5e-b4b3-37fdac67265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'volume_name': 'volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:46.940085 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085ba91-104d-4d99-83c3-99a5e574ca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:46.943695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085ba91-104d-4d99-83c3-99a5e574ca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:46.948297 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f5472e-1c6c-4f3d-b62f-cc4f5e1790bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:46.949510 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume 9a09ca45-0cf7-41bb-9c57-37de9f850cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'volume_size': 1}
Sep 06 10:54:46.949933 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] creating volume 'volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:54:46.950707 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:54:47.734279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:54:47.735250 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:54:47.738597 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f5472e-1c6c-4f3d-b62f-cc4f5e1790bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:47.743730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1accf81c-231e-4166-aa1b-5d9d8a784ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:47.823331 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0 (9a09ca45-0cf7-41bb-9c57-37de9f850cf0): created successfully
Sep 06 10:54:47.828162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1accf81c-231e-4166-aa1b-5d9d8a784ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:47.833714 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (03870dfc-5991-4087-bde9-67b654cbc849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:54:47.907138 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5bb52496-4c4e-4c09-bb27-ea90b566e761 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created volume successfully.
Sep 06 10:54:50.824380 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa req-802340e6-89aa-41af-b810-8d946fd7167b tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:54:51.503877 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:54:51.505446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:54:51.557323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:54:51.594370 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:54:51.923706 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa req-802340e6-89aa-41af-b810-8d946fd7167b tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.099s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:54:51.925933 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa req-802340e6-89aa-41af-b810-8d946fd7167b tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:54:52.063912 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa req-802340e6-89aa-41af-b810-8d946fd7167b tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Connection info returned from driver {'name': 'volumes/volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '70c1b2c2-f6d7-4051-97f3-33fa09e4502e'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:54:52.314015 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-c74fe5d9-7bf3-40f4-8516-8159502ab9fa req-802340e6-89aa-41af-b810-8d946fd7167b tempest-LiveAutoBlockMigrationV225Test-1816350742 None] attachment_update completed successfully.
Sep 06 10:54:57.338938 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:54:57.442306 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:54:57.478395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Flow 'volume_create_manager' (c16aa279-9cf9-4964-b0a1-5a0c1569cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:54:57.490645 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874fdde4-ecf6-41b3-a113-01eb4c14515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:57.511301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874fdde4-ecf6-41b3-a113-01eb4c14515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-828668783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e67a265-9fec-4ea9-98b6-e577de25d288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1af95268504c5bbed702fce756f5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:54:57Z,use_quota=True,user_id='c4e1ac1b40e94dbc80548a1f45919b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:57.520030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9fc779-f687-4d54-b628-66bae74ba1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:57.525271 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9fc779-f687-4d54-b628-66bae74ba1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:57.533508 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2319ed2e-8d0f-4fc2-99d6-5ddc56a193b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:57.539074 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2319ed2e-8d0f-4fc2-99d6-5ddc56a193b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e67a265-9fec-4ea9-98b6-e577de25d288', 'volume_name': 'volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:57.546619 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167833b4-098a-43ab-935c-b873ffe74eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:57.551760 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167833b4-098a-43ab-935c-b873ffe74eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:57.556782 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904000f5-91c9-43ef-b98a-b72b2824ee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:57.557963 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Volume 5e67a265-9fec-4ea9-98b6-e577de25d288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'volume_size': 1}
Sep 06 10:54:57.558439 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] creating volume 'volume-5e67a265-9fec-4ea9-98b6-e577de25d288' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:54:57.559228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:54:58.481009 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:54:58.481009 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:54:58.482519 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904000f5-91c9-43ef-b98a-b72b2824ee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:58.486885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faea0c8-6d09-4ac2-ba93-6b4e7167ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:54:58.583722 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Volume volume-5e67a265-9fec-4ea9-98b6-e577de25d288 (5e67a265-9fec-4ea9-98b6-e577de25d288): created successfully
Sep 06 10:54:58.587777 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faea0c8-6d09-4ac2-ba93-6b4e7167ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:54:58.593601 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Flow 'volume_create_manager' (c16aa279-9cf9-4964-b0a1-5a0c1569cb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:54:58.678316 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6d21488f-2615-4e70-b35e-fcdf3604b0d3 tempest-LiveMigrationTest-1600938040 None] Created volume successfully.
Sep 06 10:55:02.219833 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-27155b4f-c497-49c1-8e79-f7e0cf3905cd req-381102de-25e9-44c9-a0ec-774ededeffd1 tempest-LiveMigrationTest-1600938040 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:55:03.017293 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-27155b4f-c497-49c1-8e79-f7e0cf3905cd req-381102de-25e9-44c9-a0ec-774ededeffd1 tempest-LiveMigrationTest-1600938040 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.797s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:55:03.018130 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-27155b4f-c497-49c1-8e79-f7e0cf3905cd req-381102de-25e9-44c9-a0ec-774ededeffd1 tempest-LiveMigrationTest-1600938040 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '5e67a265-9fec-4ea9-98b6-e577de25d288', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:55:03.124719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-27155b4f-c497-49c1-8e79-f7e0cf3905cd req-381102de-25e9-44c9-a0ec-774ededeffd1 tempest-LiveMigrationTest-1600938040 None] Connection info returned from driver {'name': 'volumes/volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e67a265-9fec-4ea9-98b6-e577de25d288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dc9b3c89-5b43-4d80-8a00-abf114818cb4'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:55:03.274074 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-27155b4f-c497-49c1-8e79-f7e0cf3905cd req-381102de-25e9-44c9-a0ec-774ededeffd1 tempest-LiveMigrationTest-1600938040 None] attachment_update completed successfully.
Sep 06 10:55:11.488986 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-58a3b6b0-bcbc-46b5-a644-704958a1d913 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:55:12.364516 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-58a3b6b0-bcbc-46b5-a644-704958a1d913 tempest-LiveAutoBlockMigrationV225Test-880435670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.875s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:55:12.365280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-58a3b6b0-bcbc-46b5-a644-704958a1d913 tempest-LiveAutoBlockMigrationV225Test-880435670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:55:12.457435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-58a3b6b0-bcbc-46b5-a644-704958a1d913 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Connection info returned from driver {'name': 'volumes/volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9a09ca45-0cf7-41bb-9c57-37de9f850cf0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '705a33c0-017b-4240-a823-62e7f96d7581'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:55:12.596818 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-58a3b6b0-bcbc-46b5-a644-704958a1d913 tempest-LiveAutoBlockMigrationV225Test-880435670 None] attachment_update completed successfully.
Sep 06 10:55:16.054027 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-0b6e8733-2b44-4058-b037-3aae21b4d4d8 tempest-LiveMigrationTest-945793070 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:55:16.857814 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-0b6e8733-2b44-4058-b037-3aae21b4d4d8 tempest-LiveMigrationTest-945793070 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.803s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:55:16.859154 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-0b6e8733-2b44-4058-b037-3aae21b4d4d8 tempest-LiveMigrationTest-945793070 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '5e67a265-9fec-4ea9-98b6-e577de25d288', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:55:16.869796 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=49,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:55:16.965948 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-0b6e8733-2b44-4058-b037-3aae21b4d4d8 tempest-LiveMigrationTest-945793070 None] Connection info returned from driver {'name': 'volumes/volume-5e67a265-9fec-4ea9-98b6-e577de25d288', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5e67a265-9fec-4ea9-98b6-e577de25d288', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13b68ccd-e910-4b43-b93d-062b529f987f'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:55:17.183755 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-0b6e8733-2b44-4058-b037-3aae21b4d4d8 tempest-LiveMigrationTest-945793070 None] attachment_update completed successfully.
Sep 06 10:55:18.834554 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:55:18.855265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Flow 'volume_create_manager' (6fcf9268-b4b4-4690-945d-b6eba21b7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:55:18.861890 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bd04dd-e27f-46a1-80a6-51162e966cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:18.880274 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bd04dd-e27f-46a1-80a6-51162e966cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-802629847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c25a4fe-ef10-4eb2-9f79-01e2dfac335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75bc66c9c9b4fc4b76380e47b40b0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:55:19Z,use_quota=True,user_id='6559ac446c4640218ce700687045bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:18.886852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544e7f09-c013-4545-8866-afae86794a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:18.890916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544e7f09-c013-4545-8866-afae86794a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:18.895974 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e0136-365b-483d-94af-110c7b938be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:18.900539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e0136-365b-483d-94af-110c7b938be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'volume_name': 'volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:18.906795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26099a06-105a-408e-aaf1-5ea6b0ab871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:18.910988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26099a06-105a-408e-aaf1-5ea6b0ab871b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:18.916471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511d14f5-376a-4790-9b6c-cb010358afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:18.918507 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Volume 7c25a4fe-ef10-4eb2-9f79-01e2dfac335a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'volume_size': 1}
Sep 06 10:55:18.924072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] creating volume 'volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:55:18.924072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:19.551683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:55:19.552534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:55:19.557580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511d14f5-376a-4790-9b6c-cb010358afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:19.562884 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41630c5f-39da-4616-b7c1-ec6785abe69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:19.639801 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Volume volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a (7c25a4fe-ef10-4eb2-9f79-01e2dfac335a): created successfully
Sep 06 10:55:19.643399 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41630c5f-39da-4616-b7c1-ec6785abe69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:19.648803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Flow 'volume_create_manager' (6fcf9268-b4b4-4690-945d-b6eba21b7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:55:19.754313 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-397d7605-c589-4867-b6fa-8a827c2e844d tempest-AttachSCSIVolumeTestJSON-1362206888 None] Created volume successfully.
Sep 06 10:55:22.041330 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 req-f0658519-f3ef-4619-a238-10aa07556007 tempest-AttachSCSIVolumeTestJSON-1362206888 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:55:23.072282 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 req-f0658519-f3ef-4619-a238-10aa07556007 tempest-AttachSCSIVolumeTestJSON-1362206888 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.033s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:55:23.073413 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 req-f0658519-f3ef-4619-a238-10aa07556007 tempest-AttachSCSIVolumeTestJSON-1362206888 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:55:23.222806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 req-f0658519-f3ef-4619-a238-10aa07556007 tempest-AttachSCSIVolumeTestJSON-1362206888 None] Connection info returned from driver {'name': 'volumes/volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7c25a4fe-ef10-4eb2-9f79-01e2dfac335a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '83aaac5b-4f81-4f53-8126-1fdd5f9c6ac8'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:55:23.346132 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-7c2966f9-f56b-43b1-a779-4d3a5922fbf0 req-f0658519-f3ef-4619-a238-10aa07556007 tempest-AttachSCSIVolumeTestJSON-1362206888 None] attachment_update completed successfully.
Sep 06 10:55:27.157846 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-39bab9a3-fd3b-4767-b620-8a3807521e15 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Terminate volume connection completed successfully.
Sep 06 10:55:27.158492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-41338e4d-2b6a-4120-99db-4e90305130d6 req-39bab9a3-fd3b-4767-b620-8a3807521e15 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Deleting attachment 70c1b2c2-f6d7-4051-97f3-33fa09e4502e. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:55:28.246124 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b0293454-43cc-44a4-a7da-521927eecfac req-93d4f1c7-96cb-4fd2-8d42-e43202cda83a tempest-AttachSCSIVolumeTestJSON-1362206888 None] Terminate volume connection completed successfully.
Sep 06 10:55:28.248348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-b0293454-43cc-44a4-a7da-521927eecfac req-93d4f1c7-96cb-4fd2-8d42-e43202cda83a tempest-AttachSCSIVolumeTestJSON-1362206888 None] Deleting attachment 83aaac5b-4f81-4f53-8126-1fdd5f9c6ac8. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:55:30.694043 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=65,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:55:30.699681 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-f6092f82-092c-4fba-8116-959ad5c4a6ee tempest-LiveMigrationTest-945793070 None] Terminate volume connection completed successfully.
Sep 06 10:55:30.700687 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-1ccede63-9076-4733-9a16-60e63c4ba86f req-f6092f82-092c-4fba-8116-959ad5c4a6ee tempest-LiveMigrationTest-945793070 None] Deleting attachment dc9b3c89-5b43-4d80-8a00-abf114818cb4. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:55:40.644799 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-f432e34f-d4e5-433b-be4f-f8ea3323b069 req-aca729ec-f9ec-47e4-855c-d4b40272d157 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Terminate volume connection completed successfully.
Sep 06 10:55:40.645444 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-f432e34f-d4e5-433b-be4f-f8ea3323b069 req-aca729ec-f9ec-47e4-855c-d4b40272d157 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Deleting attachment 705a33c0-017b-4240-a823-62e7f96d7581. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:55:43.107756 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-d09e3209-dc68-4819-aca4-8348721c87ca req-60c02a3f-53b0-488c-b3ac-2442543d6ad8 tempest-LiveMigrationTest-1600938040 None] Terminate volume connection completed successfully.
Sep 06 10:55:43.108474 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-d09e3209-dc68-4819-aca4-8348721c87ca req-60c02a3f-53b0-488c-b3ac-2442543d6ad8 tempest-LiveMigrationTest-1600938040 None] Deleting attachment 13b68ccd-e910-4b43-b93d-062b529f987f. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:55:43.372909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:55:43.430985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (c5b2aa92-fe59-45d7-9701-f77bb4cc2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:55:43.439461 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124af9d-8ac6-4ae7-84fe-3b064b14ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:43.458541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124af9d-8ac6-4ae7-84fe-3b064b14ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-556584364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=459d4725-1cec-496c-b653-8fc2acd7f1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437799e22df2433a83eca67987e942c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:55:43Z,use_quota=True,user_id='d9f88a4c72854cff9bba7ed2920f55b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:43.464799 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dabcfd-6525-428a-9dea-ef5ea82eb080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:43.472186 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dabcfd-6525-428a-9dea-ef5ea82eb080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:43.484886 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dca7baa-f1ba-430d-99b7-cf45d77812a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:44.351796 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dca7baa-f1ba-430d-99b7-cf45d77812a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'volume_name': 'volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706d4700>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:44.360895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df728eb-58a7-4d99-bd86-6d43a638853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:44.406703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df728eb-58a7-4d99-bd86-6d43a638853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:44.420521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa4c9c4-6e67-4a4d-a93f-d0301c9c654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:44.422064 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume 459d4725-1cec-496c-b653-8fc2acd7f1d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706d4700>}
Sep 06 10:55:44.422922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Cloning 459d4725-1cec-496c-b653-8fc2acd7f1d1 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 10:55:44.424416 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:55:44.437008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:55:44.454797 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Preparing cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:889}}
Sep 06 10:55:44.456864 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 10:55:45.359380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Acquiring lock "cinder-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:55:45.389153 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Lock "cinder-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:55:45.636976 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:45.929447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:55:45.946328 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Volume volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:55:46.095288 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] deleting rbd volume volume-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:55:46.260259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:55:46.289201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Flow 'volume_create_manager' (056b9726-6169-4d2d-9f62-deba515062b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:55:46.297244 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930520cf-44cf-44b0-a1fa-5c0fc2d5b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:46.318408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930520cf-44cf-44b0-a1fa-5c0fc2d5b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-8542910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1387fcb2-03ec-4750-9f21-2c9d8cb814a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb1af95268504c5bbed702fce756f5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:55:46Z,use_quota=True,user_id='c4e1ac1b40e94dbc80548a1f45919b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:46.324467 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8a9770-bcde-4dfa-83b8-4d93d0f8f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:46.328633 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8a9770-bcde-4dfa-83b8-4d93d0f8f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:46.333734 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74a2f1e-e528-42d9-905e-883a85eec868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:46.757881 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74a2f1e-e528-42d9-905e-883a85eec868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'volume_name': 'volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7056c0d0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:46.778840 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f15f00-5aa9-4030-a524-41b8ce043458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:46.788162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f15f00-5aa9-4030-a524-41b8ce043458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:55:46.798510 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1b8b46-6f0e-4bd1-be5b-741e34c2ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:55:46.804526 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Volume 1387fcb2-03ec-4750-9f21-2c9d8cb814a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7056c0d0>}
Sep 06 10:55:46.805114 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Cloning 1387fcb2-03ec-4750-9f21-2c9d8cb814a8 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 10:55:46.808071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:55:50.157381 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=51,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:55:50.188240 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Sep 06 10:55:50.190318 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Sep 06 10:55:50.339705 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Created reservations ['686d4639-3b7e-4365-9e25-04a9f5799fe0', '29517a19-ded0-44e0-8aa1-faee2c1eda17', 'cc184cfc-6aa4-4418-bc0e-d7f1c1c039d3', '7f9001de-1eca-45ed-94a9-8d117c77354e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:55:50.647871 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:50.728584 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:50.826217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:55:50.834523 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Deleted volume successfully.
Sep 06 10:55:50.984033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b30933c7-fca3-497b-8988-61d63e272eab tempest-AttachSCSIVolumeTestJSON-1362206888 None] Lock "cinder-7c25a4fe-ef10-4eb2-9f79-01e2dfac335a-delete_volume" released by "delete_volume" :: held 5.599s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:55:51.501592 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:55:51.508708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:51.596640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:55:51.704015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:56:05.601967 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=31,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:56:08.672491 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph, size 616.00 MB, duration 24.19 sec {{(pid=133823) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Sep 06 10:56:08.673203 ncdv-master-1 cinder-volume[133823]: INFO cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Image download 616.00 MB at 25.47 MB/s
Sep 06 10:56:08.718873 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:08.847951 ncdv-master-1 sudo[147928]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph
Sep 06 10:56:08.848866 ncdv-master-1 sudo[147928]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:12.082911 ncdv-master-1 sudo[147928]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:12.089463 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph" returned: 0 in 3.370s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:12.102651 ncdv-master-1 cinder-volume[133823]: WARNING py.warnings [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Sep 06 10:56:12.102651 ncdv-master-1 cinder-volume[133823]:   debtcollector.deprecate(
Sep 06 10:56:12.102651 ncdv-master-1 cinder-volume[133823]: 
Sep 06 10:56:12.104148 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Temporary image b67f1cec-6cc8-4a81-963d-d6988be4b72f is fetched for user d9f88a4c72854cff9bba7ed2920f55b0. {{(pid=133823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Sep 06 10:56:12.297314 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:12.593921 ncdv-master-1 sudo[148009]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph
Sep 06 10:56:12.596212 ncdv-master-1 sudo[148009]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:14.547884 ncdv-master-1 sudo[148009]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:14.552220 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph" returned: 0 in 2.253s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:14.554391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] creating volume 'volume-459d4725-1cec-496c-b653-8fc2acd7f1d1' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:56:14.555852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:56:15.320840 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:56:15.321222 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:56:15.502119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Attempting download of b67f1cec-6cc8-4a81-963d-d6988be4b72f ((None, None)) to volume 459d4725-1cec-496c-b653-8fc2acd7f1d1. {{(pid=133823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 06 10:56:15.557009 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b67f1cec-6cc8-4a81-963d-d6988be4b72f_0ummv6v9 {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:15.672038 ncdv-master-1 sudo[148101]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b67f1cec-6cc8-4a81-963d-d6988be4b72f_0ummv6v9
Sep 06 10:56:15.673359 ncdv-master-1 sudo[148101]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:18.227541 ncdv-master-1 sudo[148101]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:18.230172 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_b67f1cec-6cc8-4a81-963d-d6988be4b72f_0ummv6v9" returned: 0 in 2.673s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:18.231353 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:18.479066 ncdv-master-1 sudo[148130]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph
Sep 06 10:56:18.480622 ncdv-master-1 sudo[148130]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:20.189291 ncdv-master-1 sudo[148130]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:20.192300 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph" returned: 0 in 1.961s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:20.193329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] b67f1cec-6cc8-4a81-963d-d6988be4b72f was vhdx, converting to raw {{(pid=133823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Sep 06 10:56:20.195048 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpywau6wtz {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:20.221860 ncdv-master-1 sudo[148198]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpywau6wtz
Sep 06 10:56:20.222653 ncdv-master-1 sudo[148198]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:23.564470 ncdv-master-1 sudo[148198]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:23.567622 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpywau6wtz" returned: 0 in 3.373s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:23.569215 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:23.683454 ncdv-master-1 sudo[148259]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph
Sep 06 10:56:23.684961 ncdv-master-1 sudo[148259]: pam_unix(sudo:session): session opened for user root by (uid=0)
Sep 06 10:56:25.601575 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:56:25.837828 ncdv-master-1 sudo[148259]: pam_unix(sudo:session): session closed for user root
Sep 06 10:56:25.844819 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph" returned: 0 in 2.275s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:56:25.845513 ncdv-master-1 cinder-volume[133823]: WARNING py.warnings [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Sep 06 10:56:25.845513 ncdv-master-1 cinder-volume[133823]:   debtcollector.deprecate(
Sep 06 10:56:25.845513 ncdv-master-1 cinder-volume[133823]: 
Sep 06 10:56:25.846497 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b67f1cec-6cc8-4a81-963d-d6988be4b72f_vdocux2_ncdv-master-1@ceph, size 700.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/conversion/tmpywau6wtz {{(pid=133823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Sep 06 10:56:25.846946 ncdv-master-1 cinder-volume[133823]: INFO cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Converted 700.00 MB image at 207.47 MB/s
Sep 06 10:56:25.848333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:56:26.183480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:56:26.188683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:56:26.371608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] deleting rbd volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:56:32.898328 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpywau6wtz volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:56:45.598090 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:56:51.503413 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:56:51.504462 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:56:51.632025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:56:51.682920 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:57:05.599655 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:57:15.611931 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:57:25.456574 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:57:25.502577 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Flow 'volume_create_manager' (fc18f82c-d7e6-428f-ab55-89fd54e18f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:25.542359 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca2b4d4-d5d8-4b0d-8017-f46430696ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:25.594322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca2b4d4-d5d8-4b0d-8017-f46430696ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1836827774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b57edf85-c27b-464d-bc0d-2e4c9a61792a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740286d1464549609e6d4b3280aa50ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:57:25Z,use_quota=True,user_id='6c557446cb39475dba1fc800d061b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:25.609795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e8218f-4a64-4acc-ad8c-fd6f047e191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:25.621865 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e8218f-4a64-4acc-ad8c-fd6f047e191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:25.662571 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df18a6b9-2456-42a5-aacf-47c0f677a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:25.684607 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df18a6b9-2456-42a5-aacf-47c0f677a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'volume_name': 'volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:25.714875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eaecfa-4029-4de2-8e13-37627f0ec126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:25.731053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eaecfa-4029-4de2-8e13-37627f0ec126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:25.751133 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ac7bc8-773e-4404-954f-04b90a9f6cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:25.759500 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Volume b57edf85-c27b-464d-bc0d-2e4c9a61792a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'volume_size': 1}
Sep 06 10:57:25.760140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] creating volume 'volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:57:25.761014 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:27.349959 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:57:27.351277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:57:27.357249 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ac7bc8-773e-4404-954f-04b90a9f6cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:27.372236 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4264b669-062c-453a-9eb0-1d6a9e83612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:27.523661 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Volume volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a (b57edf85-c27b-464d-bc0d-2e4c9a61792a): created successfully
Sep 06 10:57:27.530320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4264b669-062c-453a-9eb0-1d6a9e83612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:27.540454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Flow 'volume_create_manager' (fc18f82c-d7e6-428f-ab55-89fd54e18f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:27.735528 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7f184d66-065f-4ddd-97fb-da54d186952b tempest-VolumesAdminNegativeTest-204909859 None] Created volume successfully.
Sep 06 10:57:28.941952 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpywau6wtz volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 56.039s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:57:29.186282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:30.478479 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a80d0565-e216-4341-9ed4-9e9c064a1226 req-3310dc75-1bbc-4b47-9ea6-d5b611b8517f tempest-VolumesAdminNegativeTest-204909859 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:57:30.565716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:57:30.566098 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:57:30.566608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Downloaded image b67f1cec-6cc8-4a81-963d-d6988be4b72f ((None, None)) to volume 459d4725-1cec-496c-b653-8fc2acd7f1d1 successfully. {{(pid=133823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Sep 06 10:57:30.726339 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Temporary image b67f1cec-6cc8-4a81-963d-d6988be4b72f for user d9f88a4c72854cff9bba7ed2920f55b0 is deleted. {{(pid=133823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Sep 06 10:57:31.238919 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created reservations ['b4ba2d4a-3f91-43b0-a531-b5e7da4e8f77', 'd19061e8-3132-472e-acd5-03eb1c1cdaad', '37a08df8-2a2a-4952-adde-a17bcf4ac8f5', '8bdeee4a-24de-47ec-a2a3-e76f0903ca27'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:57:31.282468 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Creating image volume entry: {'provider_auth': None, 'created_at': datetime.datetime(2022, 9, 6, 10, 55, 43, tzinfo=datetime.timezone.utc), 'consistencygroup_id': None, 'cluster_name': None, 'provider_id': None, 'replication_extended_status': None, 'volume_type_id': '7eb6e771-fb45-49af-b27f-5df3f7adb754', 'host': 'ncdv-master-1@ceph#ceph', 'display_description': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'scheduled_at': datetime.datetime(2022, 9, 6, 10, 55, 43, tzinfo=datetime.timezone.utc), 'previous_status': None, 'availability_zone': 'nova', 'bootable': False, 'launched_at': None, 'volume_metadata': [], 'provider_geometry': None, 'ec2_id': None, 'group_id': None, 'deleted': False, 'volume_admin_metadata': [], 'replication_driver_data': None, 'metadata': {}, 'size': 1, 'display_name': 'image-b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'updated_at': datetime.datetime(2022, 9, 6, 10, 55, 43, tzinfo=datetime.timezone.utc), 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'provider_location': None, 'deleted_at': None, 'user_id': 'd9f88a4c72854cff9bba7ed2920f55b0', 'encryption_key_id': None, 'terminated_at': None, 'multiattach': False, 'replication_status': None, 'shared_targets': True, 'service_uuid': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '459d4725-1cec-496c-b653-8fc2acd7f1d1'}. {{(pid=133823) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}}
Sep 06 10:57:31.709534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume reschedule parameters: False retry: None {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:57:31.740298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (9ad88d7d-f707-48f8-9806-f1dee9cc6577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:31.752240 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6816154a-d9a0-42af-a280-f9802c3f6b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:31.756795 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a80d0565-e216-4341-9ed4-9e9c064a1226 req-3310dc75-1bbc-4b47-9ea6-d5b611b8517f tempest-VolumesAdminNegativeTest-204909859 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.279s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:57:31.759302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a80d0565-e216-4341-9ed4-9e9c064a1226 req-3310dc75-1bbc-4b47-9ea6-d5b611b8517f tempest-VolumesAdminNegativeTest-204909859 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:57:31.783493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6816154a-d9a0-42af-a280-f9802c3f6b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='image-b67f1cec-6cc8-4a81-963d-d6988be4b72f',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7bf55cc8-1d8b-4cbb-a608-e052442980c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4e815d95a246d5ab51c3c2719e5df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=459d4725-1cec-496c-b653-8fc2acd7f1d1,status='creating',terminated_at=None,updated_at=2022-09-06T10:55:43Z,use_quota=True,user_id='d9f88a4c72854cff9bba7ed2920f55b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:31.790922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2b9e9-45b8-4b5f-94d8-4cff44bb4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:31.797238 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2b9e9-45b8-4b5f-94d8-4cff44bb4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:31.804370 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90b34ac-c127-4a6e-8bc5-2f858637db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:31.850953 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90b34ac-c127-4a6e-8bc5-2f858637db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'volume_name': 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'volume_size': 1, 'source_volid': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'source_volstatus': 'downloading'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:31.864936 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f0f52b-8838-4b6e-bd02-0531a254ed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:31.879533 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f0f52b-8838-4b6e-bd02-0531a254ed2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:31.891929 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d71d89f-1e18-4e64-9024-72137136530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:31.893479 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'volume_size': 1, 'source_volid': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'source_volstatus': 'downloading'}
Sep 06 10:57:31.918093 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:32.077891 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] creating snapshot='volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 10:57:34.649962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] cloning 'volume-459d4725-1cec-496c-b653-8fc2acd7f1d1@volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1.clone_snap' to 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 10:57:34.654732 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a80d0565-e216-4341-9ed4-9e9c064a1226 req-3310dc75-1bbc-4b47-9ea6-d5b611b8517f tempest-VolumesAdminNegativeTest-204909859 None] Connection info returned from driver {'name': 'volumes/volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b57edf85-c27b-464d-bc0d-2e4c9a61792a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8a624a09-35d5-4682-b6bf-aaed869cbe9c'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:57:34.857036 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a80d0565-e216-4341-9ed4-9e9c064a1226 req-3310dc75-1bbc-4b47-9ea6-d5b611b8517f tempest-VolumesAdminNegativeTest-204909859 None] attachment_update completed successfully.
Sep 06 10:57:36.356751 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:57:36.358038 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:57:36.359360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:57:36.932479 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 10:57:36.940564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d71d89f-1e18-4e64-9024-72137136530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'volume_size': 1, 'source_volid': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'source_volstatus': 'downloading'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:36.956715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8391fee2-e0e5-4b28-bfc0-7d9c9eb0a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:37.186999 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1 (7bf55cc8-1d8b-4cbb-a608-e052442980c1): created successfully
Sep 06 10:57:37.191834 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8391fee2-e0e5-4b28-bfc0-7d9c9eb0a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:37.200422 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (9ad88d7d-f707-48f8-9806-f1dee9cc6577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:37.288226 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created volume successfully.
Sep 06 10:57:37.291310 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=46,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:57:37.624812 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Creating new image-volume cache entry for image b67f1cec-6cc8-4a81-963d-d6988be4b72f on ncdv-master-1@ceph#ceph {{(pid=133823) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Sep 06 10:57:37.774900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] New image-volume cache entry created: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 10, 57, 37, 628547)}. {{(pid=133823) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Sep 06 10:57:37.781441 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 113.344s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:57:37.782329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Marking volume 459d4725-1cec-496c-b653-8fc2acd7f1d1 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 10:57:37.897083 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 459d4725-1cec-496c-b653-8fc2acd7f1d1. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 10:57:37.897950 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Creating volume glance metadata for volume 459d4725-1cec-496c-b653-8fc2acd7f1d1 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 10:57:38.077336 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 111.271s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:57:38.088883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 10, 57, 38, 80942)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 10:57:38.088883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 10:57:38.088883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 10:57:38.090715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:57:38.092174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 10:57:38.099681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa4c9c4-6e67-4a4d-a93f-d0301c9c654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706d4700>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:38.104752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606bc79f-12cf-423a-a185-04ecdb659bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:38.111593 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:UPDATE=16,cinder:INSERT=21,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:57:38.114643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 10, 57, 38, 109513)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 10:57:38.115293 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 10:57:38.115859 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 10:57:38.129347 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:38.366917 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] creating snapshot='volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 10:57:41.273976 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8.clone_snap' to 'volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 10:57:41.308578 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 (459d4725-1cec-496c-b653-8fc2acd7f1d1): created successfully
Sep 06 10:57:41.312187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606bc79f-12cf-423a-a185-04ecdb659bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:41.321396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Flow 'volume_create_manager' (c5b2aa92-fe59-45d7-9701-f77bb4cc2664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:41.392368 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-56a18732-702b-4ff0-b864-084d941f5456 req-aa74ce43-7c68-47d3-9bb0-713bb8a3bd4b tempest-VolumesAdminNegativeTest-204909859 None] Terminate volume connection completed successfully.
Sep 06 10:57:41.397314 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-56a18732-702b-4ff0-b864-084d941f5456 req-aa74ce43-7c68-47d3-9bb0-713bb8a3bd4b tempest-VolumesAdminNegativeTest-204909859 None] Deleting attachment 8a624a09-35d5-4682-b6bf-aaed869cbe9c. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:57:41.546561 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ac90ce90-4299-48fb-9aaa-d98aceb6592a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created volume successfully.
Sep 06 10:57:42.643299 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:57:42.646030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:57:42.646590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:57:42.956160 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 10:57:42.956985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Marking volume 1387fcb2-03ec-4750-9f21-2c9d8cb814a8 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 10:57:43.072196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 1387fcb2-03ec-4750-9f21-2c9d8cb814a8. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 10:57:43.072661 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Creating volume glance metadata for volume 1387fcb2-03ec-4750-9f21-2c9d8cb814a8 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 10:57:43.304202 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1b8b46-6f0e-4bd1-be5b-741e34c2ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7056c0d0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:43.311994 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09676ba-0861-498f-8d87-525405c1da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:57:43.404266 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Volume volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8 (1387fcb2-03ec-4750-9f21-2c9d8cb814a8): created successfully
Sep 06 10:57:43.411976 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09676ba-0861-498f-8d87-525405c1da54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:57:43.418140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Flow 'volume_create_manager' (056b9726-6169-4d2d-9f62-deba515062b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:57:43.502654 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-90752be6-7a6e-4b90-b66c-71b0add475f6 tempest-LiveMigrationTest-1600938040 None] Created volume successfully.
Sep 06 10:57:45.631244 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-6467fc7c-fa10-43fa-845d-79a500a19435 req-fc652bef-315f-4712-ac66-a06b5884152a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:57:47.329878 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-6467fc7c-fa10-43fa-845d-79a500a19435 req-fc652bef-315f-4712-ac66-a06b5884152a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.699s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:57:47.331455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6467fc7c-fa10-43fa-845d-79a500a19435 req-fc652bef-315f-4712-ac66-a06b5884152a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:57:47.455101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-6467fc7c-fa10-43fa-845d-79a500a19435 req-fc652bef-315f-4712-ac66-a06b5884152a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Connection info returned from driver {'name': 'volumes/volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd419a288-c2c1-4974-a0d2-e2510fb53ac7'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:57:47.645517 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-6467fc7c-fa10-43fa-845d-79a500a19435 req-fc652bef-315f-4712-ac66-a06b5884152a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] attachment_update completed successfully.
Sep 06 10:57:51.509472 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:57:51.511315 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:51.592448 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:57:51.673056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:57:52.210754 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 req-bc793a66-7a43-45f9-9030-12795887e990 tempest-LiveMigrationTest-1600938040 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:57:53.207239 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 req-bc793a66-7a43-45f9-9030-12795887e990 tempest-LiveMigrationTest-1600938040 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:57:53.208183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 req-bc793a66-7a43-45f9-9030-12795887e990 tempest-LiveMigrationTest-1600938040 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:57:53.295152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 req-bc793a66-7a43-45f9-9030-12795887e990 tempest-LiveMigrationTest-1600938040 None] Connection info returned from driver {'name': 'volumes/volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df9f680a-f803-484f-b6f9-d81b389712e6'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:57:53.472518 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-8d16c6ba-4010-4df3-a93b-be15ef3680b2 req-bc793a66-7a43-45f9-9030-12795887e990 tempest-LiveMigrationTest-1600938040 None] attachment_update completed successfully.
Sep 06 10:58:05.835731 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=23,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:58:10.074295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:58:10.134078 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Flow 'volume_create_manager' (ac4b92ec-3bd7-4846-a1a6-ec17c33fabc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:10.142717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7025b-4d25-43aa-9d15-80d597316598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.161365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7025b-4d25-43aa-9d15-80d597316598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1027672928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4290afdd-d450-406f-9a50-3848de9ff313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='740286d1464549609e6d4b3280aa50ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:58:10Z,use_quota=True,user_id='6c557446cb39475dba1fc800d061b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.167847 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b3c305-83a1-472c-8090-9fb770642968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.172536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b3c305-83a1-472c-8090-9fb770642968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.178591 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6975578-5c2b-465f-b061-6e15ed8a4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.183248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6975578-5c2b-465f-b061-6e15ed8a4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4290afdd-d450-406f-9a50-3848de9ff313', 'volume_name': 'volume-4290afdd-d450-406f-9a50-3848de9ff313', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.190080 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4239fbdb-9a6a-45d2-8f9a-813c756c3e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.196765 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4239fbdb-9a6a-45d2-8f9a-813c756c3e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.207099 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64c8228-1220-463f-ae49-0b4341a23807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.210676 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Volume 4290afdd-d450-406f-9a50-3848de9ff313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4290afdd-d450-406f-9a50-3848de9ff313', 'volume_size': 1}
Sep 06 10:58:10.211357 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] creating volume 'volume-4290afdd-d450-406f-9a50-3848de9ff313' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:58:10.215152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:10.847761 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:58:10.848617 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:58:10.854595 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64c8228-1220-463f-ae49-0b4341a23807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4290afdd-d450-406f-9a50-3848de9ff313', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.863485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe75fe-74cf-4e28-ac73-a3fbc220027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:10.968847 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Volume volume-4290afdd-d450-406f-9a50-3848de9ff313 (4290afdd-d450-406f-9a50-3848de9ff313): created successfully
Sep 06 10:58:10.974404 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe75fe-74cf-4e28-ac73-a3fbc220027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:10.987454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Flow 'volume_create_manager' (ac4b92ec-3bd7-4846-a1a6-ec17c33fabc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:11.164521 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6357d112-9869-4ac0-b3e8-d84cd3844fcd tempest-VolumesAdminNegativeTest-204909859 None] Created volume successfully.
Sep 06 10:58:13.069228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Acquiring lock "cinder-4290afdd-d450-406f-9a50-3848de9ff313-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:58:13.118218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Lock "cinder-4290afdd-d450-406f-9a50-3848de9ff313-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:58:13.134950 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=11,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=12 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:58:13.403094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:13.758211 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:58:13.762396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Volume volume-4290afdd-d450-406f-9a50-3848de9ff313 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:58:13.913201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] deleting rbd volume volume-4290afdd-d450-406f-9a50-3848de9ff313 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:58:15.322701 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-ac26dd25-6fe5-4fb4-a7a4-57123ab1e6ce tempest-LiveAutoBlockMigrationV225Test-880435670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:58:18.464991 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Created reservations ['4861654c-94db-4767-b50c-c5174149f844', '7422ea68-66a8-40e4-80e3-c9a33faacd23', 'b68020ae-c35f-4854-81ae-0147dca3e10c', '8824f7c3-5256-43d8-a05c-f358bb54de3c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:58:18.769876 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:18.903726 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:18.991034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:58:18.997205 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-ac26dd25-6fe5-4fb4-a7a4-57123ab1e6ce tempest-LiveAutoBlockMigrationV225Test-880435670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 3.671s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:58:18.998868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-ac26dd25-6fe5-4fb4-a7a4-57123ab1e6ce tempest-LiveAutoBlockMigrationV225Test-880435670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:58:19.017126 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Deleted volume successfully.
Sep 06 10:58:19.130852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63966189-7e3e-4c58-9082-f9b2a1e644bc tempest-VolumesAdminNegativeTest-204909859 None] Lock "cinder-4290afdd-d450-406f-9a50-3848de9ff313-delete_volume" released by "delete_volume" :: held 6.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:58:19.220119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-ac26dd25-6fe5-4fb4-a7a4-57123ab1e6ce tempest-LiveAutoBlockMigrationV225Test-880435670 None] Connection info returned from driver {'name': 'volumes/volume-459d4725-1cec-496c-b653-8fc2acd7f1d1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '459d4725-1cec-496c-b653-8fc2acd7f1d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5a3a3f2f-997c-4200-b094-fd188c14fadb'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:58:19.495179 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-ac26dd25-6fe5-4fb4-a7a4-57123ab1e6ce tempest-LiveAutoBlockMigrationV225Test-880435670 None] attachment_update completed successfully.
Sep 06 10:58:27.389929 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:58:27.414915 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Flow 'volume_create_manager' (7af4c583-1ce4-48b1-a546-698bfa3eb3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:27.422429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60483b3-6730-4af9-8a53-0da8e65be497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:27.444143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60483b3-6730-4af9-8a53-0da8e65be497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1005235558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ed38796-f0d5-4d0a-adc7-38b9e57d52d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4061aad7f45b4c6192c02f3179d13687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:58:27Z,use_quota=True,user_id='e19903666a1243e3a66411e30babe299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:27.450330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128d2942-422c-42f0-99dc-6c17b6877b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:27.454794 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128d2942-422c-42f0-99dc-6c17b6877b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:27.465675 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81e665-481d-481d-b305-f285fbdbd07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:27.470862 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81e665-481d-481d-b305-f285fbdbd07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'volume_name': 'volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:27.475533 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbcc7dd-e4e1-4709-9849-a251d540a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:27.479749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbcc7dd-e4e1-4709-9849-a251d540a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:27.484787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c24da27-ad64-43dd-a1c2-349edf73baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:27.486610 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Volume 7ed38796-f0d5-4d0a-adc7-38b9e57d52d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'volume_size': 1}
Sep 06 10:58:27.487194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] creating volume 'volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 10:58:27.488143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:28.569611 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Acquiring lock "cinder-b57edf85-c27b-464d-bc0d-2e4c9a61792a-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:58:28.583531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Lock "cinder-b57edf85-c27b-464d-bc0d-2e4c9a61792a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:58:28.708627 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:28.917195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:58:28.921888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Volume volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:58:29.401642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] deleting rbd volume volume-b57edf85-c27b-464d-bc0d-2e4c9a61792a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:58:29.416089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:58:29.417142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:58:29.473582 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c24da27-ad64-43dd-a1c2-349edf73baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:29.490062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae5171c-94f4-4785-a3b7-903ec8f2779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:29.620622 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Volume volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0 (7ed38796-f0d5-4d0a-adc7-38b9e57d52d0): created successfully
Sep 06 10:58:29.627604 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae5171c-94f4-4785-a3b7-903ec8f2779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:29.634508 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Flow 'volume_create_manager' (7af4c583-1ce4-48b1-a546-698bfa3eb3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:29.729054 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1236df96-cbcb-4b23-841c-9db7cd43fac6 tempest-DeleteServersTestJSON-1228883101 None] Created volume successfully.
Sep 06 10:58:31.980538 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-25281bcf-ef45-44a8-8248-59b78356fb37 req-79f2d907-e7d9-4ca4-996e-47fc39b3d38f tempest-DeleteServersTestJSON-1228883101 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:58:32.064702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 10:58:32.121873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Flow 'volume_create_manager' (77bd03c8-230f-4670-a25d-a38dbb54fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:32.129457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2016111-b9fd-43a6-9cdd-e00a036b4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:32.152973 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2016111-b9fd-43a6-9cdd-e00a036b4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-391983287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=99977593-ec2b-460c-ac61-5a8c1aad3dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2ed3ceca87459d8b6db473a08b3464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T10:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T10:58:32Z,use_quota=True,user_id='a880494fb3144a58afd1fbfa8eff6cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:32.158942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0887532-500a-4818-843f-2569896113be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:32.163112 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0887532-500a-4818-843f-2569896113be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:32.168040 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62aa084-a2e5-437d-a56b-c92b18e0e2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:32.190150 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-f666bd8a-d1d6-4792-82c7-8f0d457488f1 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Terminate volume connection completed successfully.
Sep 06 10:58:32.190716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-e1eeeb75-9345-4d02-8ef2-e73b1c7305ab req-f666bd8a-d1d6-4792-82c7-8f0d457488f1 tempest-LiveAutoBlockMigrationV225Test-880435670 None] Deleting attachment d419a288-c2c1-4974-a0d2-e2510fb53ac7. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:58:32.347875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62aa084-a2e5-437d-a56b-c92b18e0e2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99977593-ec2b-460c-ac61-5a8c1aad3dad', 'volume_name': 'volume-99977593-ec2b-460c-ac61-5a8c1aad3dad', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704689d0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:32.353102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6320e8-e408-4bb7-9552-d5f84f30cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:32.357058 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6320e8-e408-4bb7-9552-d5f84f30cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:32.369441 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3b1632-1c88-483a-902c-8c526546cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:32.370611 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Volume 99977593-ec2b-460c-ac61-5a8c1aad3dad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99977593-ec2b-460c-ac61-5a8c1aad3dad', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704689d0>}
Sep 06 10:58:32.371292 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Cloning 99977593-ec2b-460c-ac61-5a8c1aad3dad from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 10:58:32.372143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:58:32.381795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:58:32.447326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 10, 58, 32, 386275)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 10:58:32.447852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 10:58:32.448360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 10:58:32.455817 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.072s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:58:32.455817 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 10:58:32.461754 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 10, 58, 32, 458989)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 10:58:32.462360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 10:58:32.463072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 10:58:32.485252 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:33.665869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] creating snapshot='volume-99977593-ec2b-460c-ac61-5a8c1aad3dad.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 10:58:36.821374 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-99977593-ec2b-460c-ac61-5a8c1aad3dad.clone_snap' to 'volume-99977593-ec2b-460c-ac61-5a8c1aad3dad' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 10:58:36.826819 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-25281bcf-ef45-44a8-8248-59b78356fb37 req-79f2d907-e7d9-4ca4-996e-47fc39b3d38f tempest-DeleteServersTestJSON-1228883101 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.846s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:58:36.828766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-25281bcf-ef45-44a8-8248-59b78356fb37 req-79f2d907-e7d9-4ca4-996e-47fc39b3d38f tempest-DeleteServersTestJSON-1228883101 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:58:36.941212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-25281bcf-ef45-44a8-8248-59b78356fb37 req-79f2d907-e7d9-4ca4-996e-47fc39b3d38f tempest-DeleteServersTestJSON-1228883101 None] Connection info returned from driver {'name': 'volumes/volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7ed38796-f0d5-4d0a-adc7-38b9e57d52d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dae88a81-e51c-4f32-bffb-b7c7b3277aa5'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:58:37.115213 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-25281bcf-ef45-44a8-8248-59b78356fb37 req-79f2d907-e7d9-4ca4-996e-47fc39b3d38f tempest-DeleteServersTestJSON-1228883101 None] attachment_update completed successfully.
Sep 06 10:58:39.068998 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:UPDATE=19 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:58:39.168845 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Created reservations ['44d71961-5111-413a-9e72-d6fa7ea1a0e1', '58ecf7c7-363a-4e4c-8f4e-52f53c88fde0', '35203642-8223-47b2-833b-fab2fedcaf23', 'd850dff6-6f24-4b56-baa6-f0cf1d1fb424'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:58:39.257034 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=64,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:58:39.342962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:58:39.346798 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 10:58:39.347259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 10:58:39.949625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 10:58:39.949625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Marking volume 99977593-ec2b-460c-ac61-5a8c1aad3dad as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 10:58:39.955764 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:39.993577 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:40.045394 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:58:40.051438 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Deleted volume successfully.
Sep 06 10:58:40.210624 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 99977593-ec2b-460c-ac61-5a8c1aad3dad. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 10:58:40.211262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Creating volume glance metadata for volume 99977593-ec2b-460c-ac61-5a8c1aad3dad backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 10:58:40.218410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b96a36e8-3842-4932-aedb-0dd1b4d47f0e tempest-VolumesAdminNegativeTest-204909859 None] Lock "cinder-b57edf85-c27b-464d-bc0d-2e4c9a61792a-delete_volume" released by "delete_volume" :: held 11.635s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:58:40.328168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3b1632-1c88-483a-902c-8c526546cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99977593-ec2b-460c-ac61-5a8c1aad3dad', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704689d0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:40.332760 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d6be95-c9ea-43e1-82f7-041f4e3ceb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 10:58:40.472933 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Volume volume-99977593-ec2b-460c-ac61-5a8c1aad3dad (99977593-ec2b-460c-ac61-5a8c1aad3dad): created successfully
Sep 06 10:58:40.476160 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d6be95-c9ea-43e1-82f7-041f4e3ceb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 10:58:40.482579 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Flow 'volume_create_manager' (77bd03c8-230f-4670-a25d-a38dbb54fa09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 10:58:40.659150 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5e9b716d-07d0-4c4c-96aa-c1b786c3f25f tempest-ServersTestBootFromVolume-577790625 None] Created volume successfully.
Sep 06 10:58:43.849385 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-72d748ac-ce1a-4aef-8d3c-579a1873f4b7 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Terminate volume connection completed successfully.
Sep 06 10:58:43.849385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-72d748ac-ce1a-4aef-8d3c-579a1873f4b7 tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Deleting attachment 5a3a3f2f-997c-4200-b094-fd188c14fadb. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:58:44.352438 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Acquiring lock "cinder-459d4725-1cec-496c-b653-8fc2acd7f1d1-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:58:44.364765 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-459d4725-1cec-496c-b653-8fc2acd7f1d1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:58:44.576970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:44.934454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:58:44.935090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] volume has clone snapshot(s) {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}}
Sep 06 10:58:44.936649 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:58:45.325014 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-68eee95c-936b-44b2-8d85-4429cd2fa780 tempest-LiveMigrationTest-945793070 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:58:46.633120 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-68eee95c-936b-44b2-8d85-4429cd2fa780 tempest-LiveMigrationTest-945793070 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.306s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:58:46.634672 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-68eee95c-936b-44b2-8d85-4429cd2fa780 tempest-LiveMigrationTest-945793070 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:58:46.798069 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-68eee95c-936b-44b2-8d85-4429cd2fa780 tempest-LiveMigrationTest-945793070 None] Connection info returned from driver {'name': 'volumes/volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1387fcb2-03ec-4750-9f21-2c9d8cb814a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80db419d-2844-432f-9250-dcbf4a4860da'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:58:46.822747 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Acquiring lock "cinder-9a09ca45-0cf7-41bb-9c57-37de9f850cf0-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:58:46.906619 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-8770ebfa-f172-49ec-8f03-6db950be9354 req-a26eec9a-37ad-48b6-8f23-e2011ebb940c tempest-DeleteServersTestJSON-1228883101 None] Terminate volume connection completed successfully.
Sep 06 10:58:46.908562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-8770ebfa-f172-49ec-8f03-6db950be9354 req-a26eec9a-37ad-48b6-8f23-e2011ebb940c tempest-DeleteServersTestJSON-1228883101 None] Deleting attachment dae88a81-e51c-4f32-bffb-b7c7b3277aa5. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:58:46.911443 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-9a09ca45-0cf7-41bb-9c57-37de9f850cf0-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:58:47.043249 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-68eee95c-936b-44b2-8d85-4429cd2fa780 tempest-LiveMigrationTest-945793070 None] attachment_update completed successfully.
Sep 06 10:58:47.122333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:47.517383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:58:47.518135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Volume volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:58:47.729007 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] deleting rbd volume volume-9a09ca45-0cf7-41bb-9c57-37de9f850cf0 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:58:47.912231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created reservations ['6dadfaf4-ff73-4a29-a8f5-c696a829683d', 'a926273f-d43c-4774-a299-a104dad911a2', '982db6d5-e0b3-404f-924c-4355d7a0fc99', 'f71f83e0-3ead-4e0b-a541-a9d7f51b65cd'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:58:48.232804 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:48.303898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:48.440901 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:58:48.464383 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Deleted volume successfully.
Sep 06 10:58:48.478345 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 req-587553f9-7a85-4837-b5c5-3d13f9e7fcf2 tempest-ServersTestBootFromVolume-577790625 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 10:58:48.571406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-e58acf14-3605-4a32-b822-f00d5ec7c488 req-b941c73a-bb79-42db-9ede-055de077054f tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-459d4725-1cec-496c-b653-8fc2acd7f1d1-delete_volume" released by "delete_volume" :: held 4.206s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:58:49.715824 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 req-587553f9-7a85-4837-b5c5-3d13f9e7fcf2 tempest-ServersTestBootFromVolume-577790625 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.238s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 10:58:49.717192 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 req-587553f9-7a85-4837-b5c5-3d13f9e7fcf2 tempest-ServersTestBootFromVolume-577790625 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99977593-ec2b-460c-ac61-5a8c1aad3dad', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '99977593-ec2b-460c-ac61-5a8c1aad3dad', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 10:58:49.825716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 req-587553f9-7a85-4837-b5c5-3d13f9e7fcf2 tempest-ServersTestBootFromVolume-577790625 None] Connection info returned from driver {'name': 'volumes/volume-99977593-ec2b-460c-ac61-5a8c1aad3dad', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99977593-ec2b-460c-ac61-5a8c1aad3dad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7a95561-2fbb-4633-9a18-57fc1746c44f'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 10:58:49.857685 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=18,cinder:SELECT=65,cinder:DELETE=2,cinder:INSERT=15 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:58:49.993254 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-affd5d77-bb2b-4f4a-a56f-2896c35ecbf2 req-587553f9-7a85-4837-b5c5-3d13f9e7fcf2 tempest-ServersTestBootFromVolume-577790625 None] attachment_update completed successfully.
Sep 06 10:58:51.513695 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:58:51.514466 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:51.581287 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:51.660669 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:58:53.277865 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Created reservations ['9906833d-34a4-4e1e-ad44-9fb16cd66c9f', 'afa56b96-e39d-47b8-841e-70a0bbfb71ab', '503594f3-e90c-4f10-90c5-75d8ea9517af', '5267f868-2f11-424c-858a-9d6fd4ef6b87'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:58:53.574341 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:53.689900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:58:53.774909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:58:53.782715 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Deleted volume successfully.
Sep 06 10:58:53.889944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9e09e56b-75b3-4869-a34f-ef9704cf325a tempest-LiveAutoBlockMigrationV225Test-1816350742 None] Lock "cinder-9a09ca45-0cf7-41bb-9c57-37de9f850cf0-delete_volume" released by "delete_volume" :: held 6.978s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:58:59.088052 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-110501e0-6d9e-42c8-8e4e-89d1be3dd6a2 tempest-LiveMigrationTest-945793070 None] Terminate volume connection completed successfully.
Sep 06 10:58:59.088588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-0ee4168d-aff3-41b5-87f0-12f014b8f229 req-110501e0-6d9e-42c8-8e4e-89d1be3dd6a2 tempest-LiveMigrationTest-945793070 None] Deleting attachment df9f680a-f803-484f-b6f9-d81b389712e6. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:59:10.212517 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-b17922a9-993e-48b2-81cd-335e398499eb tempest-LiveMigrationTest-1600938040 None] Terminate volume connection completed successfully.
Sep 06 10:59:10.213088 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-b17922a9-993e-48b2-81cd-335e398499eb tempest-LiveMigrationTest-1600938040 None] Deleting attachment 80db419d-2844-432f-9250-dcbf4a4860da. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 10:59:11.415767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Acquiring lock "cinder-1387fcb2-03ec-4750-9f21-2c9d8cb814a8-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:59:11.443000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Lock "cinder-1387fcb2-03ec-4750-9f21-2c9d8cb814a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:59:11.448973 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=65,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:59:11.577153 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:11.831265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:59:11.946604 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] deleting rbd volume volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:59:14.781830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Acquiring lock "cinder-5e67a265-9fec-4ea9-98b6-e577de25d288-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 10:59:14.830159 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Lock "cinder-5e67a265-9fec-4ea9-98b6-e577de25d288-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 10:59:14.915971 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:15.178889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 10:59:15.179899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Volume volume-5e67a265-9fec-4ea9-98b6-e577de25d288 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 10:59:15.460317 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] deleting rbd volume volume-5e67a265-9fec-4ea9-98b6-e577de25d288 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 10:59:17.700058 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 10:59:17.933719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] deleting parent snapshot volume-1387fcb2-03ec-4750-9f21-2c9d8cb814a8.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 10:59:21.775104 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Created reservations ['bf89672b-3605-46d1-a054-89d43fe8fb41', 'cc7bad80-04f9-4f03-baf8-97acd76c20ab', 'ca224890-9f21-4bdc-b390-bf2fc91e3707', 'cda42a55-4758-4d6f-8072-0d80467cf86f'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:59:22.102463 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:22.166032 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:22.250902 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:59:22.274675 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Deleted volume successfully.
Sep 06 10:59:22.413630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-1e852421-f76f-4597-b028-11ae1f8aa75e req-a5b940b0-55f0-4d0d-87d1-005d8a224977 tempest-LiveMigrationTest-1600938040 None] Lock "cinder-1387fcb2-03ec-4750-9f21-2c9d8cb814a8-delete_volume" released by "delete_volume" :: held 10.969s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:59:22.505733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Created reservations ['af3fe6a1-d28d-49d4-82e3-9874987f4006', 'a192f34a-4f39-4350-84ea-d23afc87b419', '00a47f2c-f3a1-45e9-8fe6-68f1429bfb85', '50c2f116-b3d8-4689-be3e-f900309fefdb'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 10:59:22.796452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:22.911792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:23.024979 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:59:23.030923 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Deleted volume successfully.
Sep 06 10:59:23.143248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1ed7084e-4aa1-454b-ac67-565645178d3a tempest-LiveMigrationTest-1600938040 None] Lock "cinder-5e67a265-9fec-4ea9-98b6-e577de25d288-delete_volume" released by "delete_volume" :: held 8.342s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 10:59:33.046100 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=43,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:59:46.887944 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 10:59:51.516525 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 10:59:51.517225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:51.590655 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 10:59:51.770637 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 10:59:56.889471 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:00:26.860261 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:00:36.867982 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:00:51.521027 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:00:51.521870 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:00:51.631109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:00:51.695310 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:00:56.872534 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:01:06.870406 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:01:26.869717 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:01:28.844874 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:01:28.937829 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:01:28.968910 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Flow 'volume_create_manager' (16e5a7f1-24dc-430a-9045-d670cabed358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:01:28.976824 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4a6ff2-8e30-4615-8be0-a9ac777f7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:28.996923 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4a6ff2-8e30-4615-8be0-a9ac777f7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-941941593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c06b8fd0-5487-4196-9a22-561a67e2c459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e57d652e04149709c4d6b3cb160d7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:01:29Z,use_quota=True,user_id='448ccb88a71546c9b4bd1960e9c213b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:29.002363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f9ff6-b231-4e63-9e54-6d9228ac508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:29.006753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f9ff6-b231-4e63-9e54-6d9228ac508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:29.013205 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2d4bac-d430-4a03-b82a-7b1441034650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:29.017681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2d4bac-d430-4a03-b82a-7b1441034650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06b8fd0-5487-4196-9a22-561a67e2c459', 'volume_name': 'volume-c06b8fd0-5487-4196-9a22-561a67e2c459', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:29.024241 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2b51b5-4bad-4e40-a03a-aea2e1df5946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:29.029120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2b51b5-4bad-4e40-a03a-aea2e1df5946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:29.034345 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11fb1be-e999-45e2-8c63-ecc3eee81451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:29.035874 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Volume c06b8fd0-5487-4196-9a22-561a67e2c459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06b8fd0-5487-4196-9a22-561a67e2c459', 'volume_size': 1}
Sep 06 11:01:29.036432 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] creating volume 'volume-c06b8fd0-5487-4196-9a22-561a67e2c459' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:01:29.037380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:30.751912 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:01:30.752480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:01:30.756117 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11fb1be-e999-45e2-8c63-ecc3eee81451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06b8fd0-5487-4196-9a22-561a67e2c459', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:30.762290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9be246-c026-478b-b400-68c8a7a6197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:01:30.833349 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Volume volume-c06b8fd0-5487-4196-9a22-561a67e2c459 (c06b8fd0-5487-4196-9a22-561a67e2c459): created successfully
Sep 06 11:01:30.837860 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9be246-c026-478b-b400-68c8a7a6197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:01:30.844999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Flow 'volume_create_manager' (16e5a7f1-24dc-430a-9045-d670cabed358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:01:30.950699 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-af2e48a5-ed85-4925-b00c-b9f38f71a1cd tempest-SnapshotsActionsTest-1101373851 None] Created volume successfully.
Sep 06 11:01:32.700031 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ebf849cd-03ec-49d4-8998-ec7c460ca8b1 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:37.935579 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ebf849cd-03ec-49d4-8998-ec7c460ca8b1 tempest-SnapshotsActionsTest-1101373851 None] Create snapshot completed successfully
Sep 06 11:01:40.172005 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d2e529a8-4e84-4987-874d-c0f5e9e1ff73 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:43.049870 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d2e529a8-4e84-4987-874d-c0f5e9e1ff73 tempest-SnapshotsActionsTest-1101373851 None] Create snapshot completed successfully
Sep 06 11:01:44.502564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Acquiring lock "cinder-77e1df5e-bfba-42bb-bbb9-92011f09fe08-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:01:44.525524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-77e1df5e-bfba-42bb-bbb9-92011f09fe08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:01:44.528776 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:48.453083 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:01:48.546804 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Created reservations ['16fb8e94-ca15-4081-ae4d-eb1e2cbd391c', '9f871497-b515-4de8-a67e-6252be6ad27a', '59c82990-e6f2-4a3a-877e-8954ebcfe23f', 'c3d292af-a2e8-4882-818a-0eee1c0142c6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:01:48.833310 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Delete snapshot completed successfully.
Sep 06 11:01:48.840302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-63090a01-3e32-4d46-93c3-f73ea4f13f20 tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-77e1df5e-bfba-42bb-bbb9-92011f09fe08-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:01:50.008953 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aa1f293c-9784-4bd2-9054-7ce85d326049 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:51.520268 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:01:51.521224 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:51.630007 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:01:51.730457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:01:55.004370 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aa1f293c-9784-4bd2-9054-7ce85d326049 tempest-SnapshotsActionsTest-1101373851 None] Create snapshot completed successfully
Sep 06 11:01:56.041338 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] Acquiring lock "cinder-3637b880-cbf6-4794-bb92-1edc5154e19c-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:01:56.061637 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-3637b880-cbf6-4794-bb92-1edc5154e19c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:01:56.074231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:00.552165 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=29,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:02:00.552759 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=34,cinder:UPDATE=12,cinder:DELETE=3,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:02:00.710535 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] Created reservations ['7802aa6d-1cb7-4a85-9c5c-3482106d68d9', 'fd9a6451-554f-4aaf-9727-d59b2d294b58', '6a08fcd6-574c-4dfa-a2a7-eb752887f347', 'bc3cab04-5e8d-4a0d-933c-ed896f4485e4'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:01.184230 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] Delete snapshot completed successfully.
Sep 06 11:02:01.205220 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cf1d6fdf-a7c2-4295-8115-dbbee97705db tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-3637b880-cbf6-4794-bb92-1edc5154e19c-delete_snapshot" released by "delete_snapshot" :: held 5.144s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:02.521998 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-312e82e4-3fac-4c57-a854-12e8fab696a8 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:07.198851 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-312e82e4-3fac-4c57-a854-12e8fab696a8 tempest-SnapshotsActionsTest-1101373851 None] Create snapshot completed successfully
Sep 06 11:02:08.075343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] Acquiring lock "cinder-22c24fe1-67e4-4839-900d-323020f79016-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:02:08.086653 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-22c24fe1-67e4-4839-900d-323020f79016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:02:08.091259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:11.912980 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] Created reservations ['be6c6363-5c30-49e2-87ae-233ae5cbc74f', '9fd25182-1c5d-43b0-8817-9f912ccba269', 'ea238aa7-d105-471d-8ebe-4cfd56724d05', '469492f3-e546-4972-a154-20efd0e563aa'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:12.273877 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] Delete snapshot completed successfully.
Sep 06 11:02:12.282166 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9012a430-c37c-4b1f-833c-b93ee347357b tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-22c24fe1-67e4-4839-900d-323020f79016-delete_snapshot" released by "delete_snapshot" :: held 4.192s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:13.417564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6c1daaff-323b-44f0-8af7-f8ca082a9416 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:17.118772 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6c1daaff-323b-44f0-8af7-f8ca082a9416 tempest-SnapshotsActionsTest-1101373851 None] Create snapshot completed successfully
Sep 06 11:02:17.591875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] Acquiring lock "cinder-6be7706f-747e-4803-9bda-2c26f829445f-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:02:17.609625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-6be7706f-747e-4803-9bda-2c26f829445f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:02:17.613894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:21.524885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] Created reservations ['9893803c-f304-477c-9a96-49d69d67270b', '4b1237d2-a541-4fe3-8fdc-61eec6661be5', '6d27f401-5c47-418d-b6d4-029d55eb4ade', '3abeb58f-b942-4ba9-b342-5bbe740a5687'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:21.800953 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] Delete snapshot completed successfully.
Sep 06 11:02:21.812848 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-976cfaf0-51fc-4e9d-b49a-502cd86484a2 tempest-SnapshotsActionsTest-1139102550 None] Lock "cinder-6be7706f-747e-4803-9bda-2c26f829445f-delete_snapshot" released by "delete_snapshot" :: held 4.203s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:23.175267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] Acquiring lock "cinder-847f8154-40bc-44cf-adbe-b1402dfa40a7-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:02:23.200967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] Lock "cinder-847f8154-40bc-44cf-adbe-b1402dfa40a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:02:23.203045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:27.839477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] Created reservations ['59827df4-e4ec-442f-91a9-2eb5f5283e2a', 'ceb3ac38-316d-47c7-9154-63c64afd2fbd', 'a0ed2867-23dc-42bd-9f3c-621acb44169a', '478ed9b5-2d13-4632-a5de-36a9fc095e81'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:28.101752 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] Delete snapshot completed successfully.
Sep 06 11:02:28.107286 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2fcf2c2a-d277-41d2-9399-70891ccea8fe tempest-SnapshotsActionsTest-1101373851 None] Lock "cinder-847f8154-40bc-44cf-adbe-b1402dfa40a7-delete_snapshot" released by "delete_snapshot" :: held 4.910s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:28.808846 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Acquiring lock "cinder-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:02:28.831490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Lock "cinder-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:02:28.874055 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Acquiring lock "cinder-c06b8fd0-5487-4196-9a22-561a67e2c459-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:02:28.908547 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Lock "cinder-c06b8fd0-5487-4196-9a22-561a67e2c459-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:02:28.979742 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:29.307679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:02:29.308470 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Volume volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:02:29.540471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] deleting rbd volume volume-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:02:29.584019 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:02:29.589784 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:29.934127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:02:29.940587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Volume volume-c06b8fd0-5487-4196-9a22-561a67e2c459 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:02:30.249719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] deleting rbd volume volume-c06b8fd0-5487-4196-9a22-561a67e2c459 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:02:36.893490 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=52,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:02:39.869477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Created reservations ['da934bf4-ee6d-4768-b312-36f8f6530d8c', '133d4f61-73ec-4270-9d49-e662099bb07e', '5fb17fc3-4088-4f06-a384-502d6fbd745f', '3195bf0c-8834-4d9f-86a8-acd53ce1adba'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:39.871541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Created reservations ['6b7ce7e6-2ffa-40f2-b35f-2af887d0a359', 'f6ad23aa-0ecc-4b1a-8103-6839e9c30718', 'd19b7788-0c09-4f11-a529-3407de74d831', 'fe30587d-96d9-4ff3-88da-bab672eb7ae1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:02:40.202881 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:40.280073 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:40.324253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:02:40.331679 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Deleted volume successfully.
Sep 06 11:02:40.434411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:40.502712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:40.583814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:02:40.589026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-417667a7-338f-412e-88d1-035f73c3e9fd tempest-DeleteServersTestJSON-1228883101 None] Lock "cinder-7ed38796-f0d5-4d0a-adc7-38b9e57d52d0-delete_volume" released by "delete_volume" :: held 11.757s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:40.590422 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Deleted volume successfully.
Sep 06 11:02:40.665220 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-350028b6-954b-4d10-ac70-a2421dff00f3 tempest-SnapshotsActionsTest-1101373851 None] Lock "cinder-c06b8fd0-5487-4196-9a22-561a67e2c459-delete_volume" released by "delete_volume" :: held 11.757s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:02:50.594920 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:02:51.522660 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:02:51.523354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:51.585018 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:02:51.705246 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:02:56.899656 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:03:06.924472 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:03:07.752742 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:03:07.779291 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (c44247bd-9521-4302-84d4-3d2e74a71913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:07.796974 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ae308-07cc-41f1-8c71-36c7f4af8d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:07.825212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ae308-07cc-41f1-8c71-36c7f4af8d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1305890485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=07bb7589-fa11-4232-8086-c15cca8ad494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f753981cf9264d27b16090d7499bf372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:03:07Z,use_quota=True,user_id='176b78609fe64a958eb12cddae83c0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:07.832428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d60154f-01fb-4a33-acf9-4db2ce887148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:07.837681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d60154f-01fb-4a33-acf9-4db2ce887148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:07.843361 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d0500-390f-4ef8-89ff-259738c8f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:07.980780 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d0500-390f-4ef8-89ff-259738c8f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07bb7589-fa11-4232-8086-c15cca8ad494', 'volume_name': 'volume-07bb7589-fa11-4232-8086-c15cca8ad494', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704e5a60>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:07.996394 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8d6c15-708b-4adf-aa4f-4c5a08184734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:08.001627 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8d6c15-708b-4adf-aa4f-4c5a08184734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:08.010258 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0d85d2-78e1-4347-9eda-cb5cda4eff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:08.014175 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Volume 07bb7589-fa11-4232-8086-c15cca8ad494: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07bb7589-fa11-4232-8086-c15cca8ad494', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704e5a60>}
Sep 06 11:03:08.014175 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Cloning 07bb7589-fa11-4232-8086-c15cca8ad494 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:03:08.014638 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:03:08.023554 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:03:08.116962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 3, 8, 29269)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:03:08.118043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:03:08.122448 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:03:08.125856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.102s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:03:08.127423 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:03:08.136080 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 3, 8, 133210)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:03:08.136647 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:03:08.137293 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:03:08.150976 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:08.550561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] creating snapshot='volume-07bb7589-fa11-4232-8086-c15cca8ad494.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:03:11.007967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-07bb7589-fa11-4232-8086-c15cca8ad494.clone_snap' to 'volume-07bb7589-fa11-4232-8086-c15cca8ad494' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:03:11.084200 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:03:11.103281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Flow 'volume_create_manager' (edfb30dc-df2f-42c2-804f-9cfcd54ca048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:11.109756 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4696d0a4-8a00-40ba-8e15-516c4cf6ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:11.128335 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4696d0a4-8a00-40ba-8e15-516c4cf6ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-336767671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa881b26-3f44-472a-beb9-ca6525dbe95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bb720baeb34b4bb625b338646c9819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:03:08Z,use_quota=True,user_id='1f730c7032814297ad6009c89452b3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:11.134646 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38082663-c758-438e-9a5b-0b768c16434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:11.143528 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38082663-c758-438e-9a5b-0b768c16434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:11.146957 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0b7558-a666-4e7d-a7a2-3d1508e27a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:11.151197 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0b7558-a666-4e7d-a7a2-3d1508e27a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa881b26-3f44-472a-beb9-ca6525dbe95f', 'volume_name': 'volume-aa881b26-3f44-472a-beb9-ca6525dbe95f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:11.156109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815fc1a0-c1a9-4884-aa97-9dd0ddf301e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:11.159970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815fc1a0-c1a9-4884-aa97-9dd0ddf301e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:11.166452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37da9d78-0643-40a2-b6a2-fda8d94fd5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:11.167792 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Volume aa881b26-3f44-472a-beb9-ca6525dbe95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa881b26-3f44-472a-beb9-ca6525dbe95f', 'volume_size': 1}
Sep 06 11:03:11.168385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] creating volume 'volume-aa881b26-3f44-472a-beb9-ca6525dbe95f' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:03:11.174238 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:12.395607 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:03:12.396162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:03:12.400408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37da9d78-0643-40a2-b6a2-fda8d94fd5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa881b26-3f44-472a-beb9-ca6525dbe95f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:12.406061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910c2c2-8b51-4cae-a1b0-fc407ee1b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:12.476864 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Volume volume-aa881b26-3f44-472a-beb9-ca6525dbe95f (aa881b26-3f44-472a-beb9-ca6525dbe95f): created successfully
Sep 06 11:03:12.480516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910c2c2-8b51-4cae-a1b0-fc407ee1b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:12.485783 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Flow 'volume_create_manager' (edfb30dc-df2f-42c2-804f-9cfcd54ca048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:12.636459 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-19b81e22-ade5-45de-b9c5-4dc90f419b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Created volume successfully.
Sep 06 11:03:13.303045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:03:13.309575 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:03:13.309959 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:03:13.938752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:03:13.939400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Marking volume 07bb7589-fa11-4232-8086-c15cca8ad494 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:03:14.021263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 07bb7589-fa11-4232-8086-c15cca8ad494. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:03:14.021906 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Creating volume glance metadata for volume 07bb7589-fa11-4232-8086-c15cca8ad494 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:03:14.041509 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-54ea8655-5196-4944-9219-2d4101facc41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:14.524080 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0d85d2-78e1-4347-9eda-cb5cda4eff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bb7589-fa11-4232-8086-c15cca8ad494', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704e5a60>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:14.530746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b859f4e3-e9d3-49f1-8324-1cbd17eee9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:14.596329 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-07bb7589-fa11-4232-8086-c15cca8ad494 (07bb7589-fa11-4232-8086-c15cca8ad494): created successfully
Sep 06 11:03:14.600644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b859f4e3-e9d3-49f1-8324-1cbd17eee9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:14.607231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (c44247bd-9521-4302-84d4-3d2e74a71913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:14.756785 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7df87d92-104b-4311-af30-063c5cc4e9d5 tempest-TaggedBootDevicesTest-1190023964 None] Created volume successfully.
Sep 06 11:03:15.916826 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:03:15.949981 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (93246d9a-d204-4f84-82b1-b963dd71e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:15.959501 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d43e628-874d-4f8d-b314-40172e4ec367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:15.976012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d43e628-874d-4f8d-b314-40172e4ec367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1155913898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6fa4f767-334d-44e6-a00b-ae05aa708fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f753981cf9264d27b16090d7499bf372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:03:16Z,use_quota=True,user_id='176b78609fe64a958eb12cddae83c0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:15.981374 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac6969f-50ee-49a8-b153-32ced5d6207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:15.990885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac6969f-50ee-49a8-b153-32ced5d6207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:15.992382 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a32e082-b99a-4d8a-90b1-2a626b947fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:15.996482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a32e082-b99a-4d8a-90b1-2a626b947fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa4f767-334d-44e6-a00b-ae05aa708fde', 'volume_name': 'volume-6fa4f767-334d-44e6-a00b-ae05aa708fde', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:16.001447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade49d02-2e8c-4ab3-9cc7-b36331f6a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:16.005395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade49d02-2e8c-4ab3-9cc7-b36331f6a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:16.010256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96f805-01f8-46aa-bc7a-a8d7ab73bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:16.011360 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Volume 6fa4f767-334d-44e6-a00b-ae05aa708fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa4f767-334d-44e6-a00b-ae05aa708fde', 'volume_size': 1}
Sep 06 11:03:16.011757 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] creating volume 'volume-6fa4f767-334d-44e6-a00b-ae05aa708fde' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:03:16.012406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:17.090978 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:03:17.091583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:03:17.095254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa96f805-01f8-46aa-bc7a-a8d7ab73bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa4f767-334d-44e6-a00b-ae05aa708fde', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:17.100703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d3607e-acbf-4370-989c-699754710d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:17.168231 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-6fa4f767-334d-44e6-a00b-ae05aa708fde (6fa4f767-334d-44e6-a00b-ae05aa708fde): created successfully
Sep 06 11:03:17.172143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d3607e-acbf-4370-989c-699754710d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:17.178205 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (93246d9a-d204-4f84-82b1-b963dd71e247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:17.252919 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c16b8e5b-b936-4ab2-9cc0-8ce37e2a0bf6 tempest-TaggedBootDevicesTest-1190023964 None] Created volume successfully.
Sep 06 11:03:17.580668 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-54ea8655-5196-4944-9219-2d4101facc41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Create snapshot completed successfully
Sep 06 11:03:18.833630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:03:18.915814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (ec4526ce-e08d-453f-9d94-9f5e3b6aa3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:18.953286 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045b5044-02a7-4996-92f9-1c696f5b9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:19.008985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045b5044-02a7-4996-92f9-1c696f5b9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-39852822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=97c4f2af-7999-4949-95b8-1d95f5cb1b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f753981cf9264d27b16090d7499bf372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:03:19Z,use_quota=True,user_id='176b78609fe64a958eb12cddae83c0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:19.033526 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c0226-c7af-41b2-94cb-c679adda4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:19.069115 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c0226-c7af-41b2-94cb-c679adda4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:19.102142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33411ebd-72d7-42d7-992a-34895a371d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:19.115162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33411ebd-72d7-42d7-992a-34895a371d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'volume_name': 'volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:19.128771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51de756d-0ccc-4011-b79d-c5655fd06d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:19.151188 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51de756d-0ccc-4011-b79d-c5655fd06d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:19.158140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48432aa-3438-4f21-9e4a-41d33db6614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:19.159508 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Volume 97c4f2af-7999-4949-95b8-1d95f5cb1b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'volume_size': 1}
Sep 06 11:03:19.160045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] creating volume 'volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:03:19.161134 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:19.847371 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Acquiring lock "cinder-7e4d2665-3f04-4a64-bdf4-0a201b832793-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:03:19.879679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Lock "cinder-7e4d2665-3f04-4a64-bdf4-0a201b832793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:03:19.881280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:20.519863 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:03:20.520281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:03:20.524670 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48432aa-3438-4f21-9e4a-41d33db6614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:20.529162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941a6450-6b87-4a50-b04e-e0f8c7406bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:20.641903 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56 (97c4f2af-7999-4949-95b8-1d95f5cb1b56): created successfully
Sep 06 11:03:20.647169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941a6450-6b87-4a50-b04e-e0f8c7406bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:20.653276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Flow 'volume_create_manager' (ec4526ce-e08d-453f-9d94-9f5e3b6aa3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:20.784872 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-27f74cf4-c215-4585-808f-1e80cbbc01e9 tempest-TaggedBootDevicesTest-1190023964 None] Created volume successfully.
Sep 06 11:03:24.933827 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Created reservations ['5c24430f-d0be-478a-bca7-7cbd62a9955d', '9cefbe6f-4739-4e66-a9da-3804a73d9b2f', 'b32f073a-9489-41cb-9c1f-4fa8902ad48d', '15b6b379-56ff-4b4c-a2d0-28a8cf4e96b3'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:03:25.179340 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Delete snapshot completed successfully.
Sep 06 11:03:25.184330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-817d17b6-cb7f-4b83-975c-b486a657fdb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Lock "cinder-7e4d2665-3f04-4a64-bdf4-0a201b832793-delete_snapshot" released by "delete_snapshot" :: held 5.305s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:03:25.401286 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Acquiring lock "cinder-aa881b26-3f44-472a-beb9-ca6525dbe95f-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:03:25.415913 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Lock "cinder-aa881b26-3f44-472a-beb9-ca6525dbe95f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:03:25.588217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:25.815117 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:03:25.816326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Volume volume-aa881b26-3f44-472a-beb9-ca6525dbe95f is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:03:25.959195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] deleting rbd volume volume-aa881b26-3f44-472a-beb9-ca6525dbe95f {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:03:33.642622 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=54,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:03:33.807327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Created reservations ['bb96975d-8255-4587-98c4-d916daee5c94', '13dfce33-1ce4-4674-b02e-8f905b5ade5f', '69553135-56b3-483c-b85e-489e92ad661a', '77787b68-1a78-444b-9f18-6c08fd766290'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:03:33.965537 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=59,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=13 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:03:34.071047 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:34.137025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:34.211888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:03:34.218710 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Deleted volume successfully.
Sep 06 11:03:34.327877 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-187562b4-10df-4139-8391-ec35d58b63df tempest-VolumeSnapshotQuotasNegativeTestJSON-2079177758 None] Lock "cinder-aa881b26-3f44-472a-beb9-ca6525dbe95f-delete_volume" released by "delete_volume" :: held 8.910s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:03:48.209642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:03:48.242356 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Flow 'volume_create_manager' (0438b4cc-5f87-4f96-a3b4-072fa4103dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:48.264872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab01e8-2696-4fbd-8536-e956eb4dfcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:48.299379 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab01e8-2696-4fbd-8536-e956eb4dfcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1080119814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=192061d2-93b9-432e-8a97-d412f83ee4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8052bbf12c694a9eb067ba351538ce8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:03:48Z,use_quota=True,user_id='55653ffb98a841e599b1305dcd1ec6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:48.321666 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b46118-facd-4d5d-8c61-22b3a435ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:48.332102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b46118-facd-4d5d-8c61-22b3a435ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:48.346396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b411e25-be32-4b01-a05a-ced4fb1ba47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:48.355260 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b411e25-be32-4b01-a05a-ced4fb1ba47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192061d2-93b9-432e-8a97-d412f83ee4d8', 'volume_name': 'volume-192061d2-93b9-432e-8a97-d412f83ee4d8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:48.361453 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f481013-826c-4d7f-8bbe-fea2a1bae3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:48.367476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f481013-826c-4d7f-8bbe-fea2a1bae3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:48.372763 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d421e-c108-42c7-803c-d0eb2404fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:48.374170 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Volume 192061d2-93b9-432e-8a97-d412f83ee4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192061d2-93b9-432e-8a97-d412f83ee4d8', 'volume_size': 1}
Sep 06 11:03:48.374768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] creating volume 'volume-192061d2-93b9-432e-8a97-d412f83ee4d8' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:03:48.375733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:48.445059 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-263594c8-7253-4b7b-808f-d04663a0795f tempest-TaggedBootDevicesTest-1190023964 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:03:49.737705 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-263594c8-7253-4b7b-808f-d04663a0795f tempest-TaggedBootDevicesTest-1190023964 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.291s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:03:49.741994 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-263594c8-7253-4b7b-808f-d04663a0795f tempest-TaggedBootDevicesTest-1190023964 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-07bb7589-fa11-4232-8086-c15cca8ad494', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '07bb7589-fa11-4232-8086-c15cca8ad494', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:03:49.774363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:03:49.775635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:03:49.781584 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d421e-c108-42c7-803c-d0eb2404fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192061d2-93b9-432e-8a97-d412f83ee4d8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:49.787457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20de0a2-6165-4b86-a439-619623c97f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:03:49.892916 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Volume volume-192061d2-93b9-432e-8a97-d412f83ee4d8 (192061d2-93b9-432e-8a97-d412f83ee4d8): created successfully
Sep 06 11:03:49.897966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20de0a2-6165-4b86-a439-619623c97f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:03:49.913914 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Flow 'volume_create_manager' (0438b4cc-5f87-4f96-a3b4-072fa4103dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:03:49.962237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-263594c8-7253-4b7b-808f-d04663a0795f tempest-TaggedBootDevicesTest-1190023964 None] Connection info returned from driver {'name': 'volumes/volume-07bb7589-fa11-4232-8086-c15cca8ad494', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '07bb7589-fa11-4232-8086-c15cca8ad494', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0847f6b8-5163-41e1-b447-daf46c628d80'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:03:50.018447 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e2db4bda-c3df-4971-a567-c42d68da52fe tempest-VolumesBackupsV39Test-1125418662 None] Created volume successfully.
Sep 06 11:03:50.178284 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-263594c8-7253-4b7b-808f-d04663a0795f tempest-TaggedBootDevicesTest-1190023964 None] attachment_update completed successfully.
Sep 06 11:03:51.198887 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-b4fbc91d-a758-4379-8c2a-07d265f85884 tempest-TaggedBootDevicesTest-1190023964 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:03:51.411800 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:03:50Z,data_timestamp=2022-09-06T11:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1945999712',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=44b204b4-7e8e-486f-854b-bffd0221b674,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8052bbf12c694a9eb067ba351538ce8f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='55653ffb98a841e599b1305dcd1ec6be',volume_id=192061d2-93b9-432e-8a97-d412f83ee4d8)
Sep 06 11:03:51.418822 ncdv-master-1 cinder-volume[133823]: INFO cinder.rpc [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Sep 06 11:03:51.430004 ncdv-master-1 cinder-volume[133823]: INFO cinder.rpc [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Sep 06 11:03:51.431456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] continue_backup in rpcapi backup_id 44b204b4-7e8e-486f-854b-bffd0221b674 {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:03:51.519576 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:03:51.521275 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:51.603096 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:03:51.788015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:03:52.228457 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-b4fbc91d-a758-4379-8c2a-07d265f85884 tempest-TaggedBootDevicesTest-1190023964 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.022s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:03:52.228457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-b4fbc91d-a758-4379-8c2a-07d265f85884 tempest-TaggedBootDevicesTest-1190023964 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6fa4f767-334d-44e6-a00b-ae05aa708fde', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '6fa4f767-334d-44e6-a00b-ae05aa708fde', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:03:52.389966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-b4fbc91d-a758-4379-8c2a-07d265f85884 tempest-TaggedBootDevicesTest-1190023964 None] Connection info returned from driver {'name': 'volumes/volume-6fa4f767-334d-44e6-a00b-ae05aa708fde', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6fa4f767-334d-44e6-a00b-ae05aa708fde', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '089373d6-7261-470c-8e10-49c1c81979f2'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:03:52.531299 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-b4fbc91d-a758-4379-8c2a-07d265f85884 tempest-TaggedBootDevicesTest-1190023964 None] attachment_update completed successfully.
Sep 06 11:03:53.350367 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-d7d46385-445d-408f-b309-5926a6a440c2 tempest-TaggedBootDevicesTest-1190023964 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:03:54.636527 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-d7d46385-445d-408f-b309-5926a6a440c2 tempest-TaggedBootDevicesTest-1190023964 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.287s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:03:54.637407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-d7d46385-445d-408f-b309-5926a6a440c2 tempest-TaggedBootDevicesTest-1190023964 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:03:54.796993 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-d7d46385-445d-408f-b309-5926a6a440c2 tempest-TaggedBootDevicesTest-1190023964 None] Connection info returned from driver {'name': 'volumes/volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '97c4f2af-7999-4949-95b8-1d95f5cb1b56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b0aec71-70cd-4bf3-8d00-b06f07c5a351'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:03:55.032705 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-254f5806-449f-4fa8-b8b5-b00f1d47f46a req-d7d46385-445d-408f-b309-5926a6a440c2 tempest-TaggedBootDevicesTest-1190023964 None] attachment_update completed successfully.
Sep 06 11:03:55.675875 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:03:56.744717 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.071s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:03:56.746238 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-192061d2-93b9-432e-8a97-d412f83ee4d8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '192061d2-93b9-432e-8a97-d412f83ee4d8', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:03:56.776928 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Initialize volume connection completed successfully.
Sep 06 11:04:06.899437 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=45,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:04:09.112199 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=13,cinder:SELECT=51,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:04:09.117920 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Terminate volume connection completed successfully.
Sep 06 11:04:09.170953 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-bd9ef5bd-7d96-4e6b-b724-ad689219ac80 tempest-VolumesBackupsV39Test-1125418662 None] Remove volume export completed successfully.
Sep 06 11:04:22.077836 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Acquiring lock "cinder-192061d2-93b9-432e-8a97-d412f83ee4d8-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:04:22.104369 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Lock "cinder-192061d2-93b9-432e-8a97-d412f83ee4d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:04:22.311160 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:25.372279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Volume volume-192061d2-93b9-432e-8a97-d412f83ee4d8 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:04:26.044846 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] deleting rbd volume volume-192061d2-93b9-432e-8a97-d412f83ee4d8 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:04:32.309681 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:04:34.433848 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Created reservations ['d610b84b-1511-46ea-8fab-459b23d489dc', '308c6951-683a-4197-a1c3-222aefeaf547', 'e8abf130-f9c9-46d8-b212-1a15c9a41ec6', 'a4629852-5209-418a-bb4b-8ad0277a482c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:04:34.641958 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:34.690054 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:34.747376 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:04:34.752506 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Deleted volume successfully.
Sep 06 11:04:34.868994 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6e4dc095-5390-45c7-b205-4842029ec6cc tempest-VolumesBackupsV39Test-1125418662 None] Lock "cinder-192061d2-93b9-432e-8a97-d412f83ee4d8-delete_volume" released by "delete_volume" :: held 12.765s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:04:39.648240 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:04:39.670811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Flow 'volume_create_manager' (ce9acf23-f70c-4b20-8543-5a92ce5485c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:04:39.678411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e46d8a-fdec-454b-963b-1a777b6e0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:39.697823 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e46d8a-fdec-454b-963b-1a777b6e0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1379647864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=41cf2a15-0d91-4469-9887-1dbb210857f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe32cefcc04db29316568d5e8ddb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:04:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:04:39Z,use_quota=True,user_id='0454b13d38c64d0eb91d7d512a065f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:39.705271 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17c762c-df90-4adf-9711-ca9944d0df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:39.709532 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17c762c-df90-4adf-9711-ca9944d0df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:39.714771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b4fa08-12d7-4b71-887b-a5a5dcd91c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:39.719642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b4fa08-12d7-4b71-887b-a5a5dcd91c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cf2a15-0d91-4469-9887-1dbb210857f3', 'volume_name': 'volume-41cf2a15-0d91-4469-9887-1dbb210857f3', 'volume_size': 2}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:39.726254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bc231-67e2-4852-85b3-61e05c14896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:39.742102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bc231-67e2-4852-85b3-61e05c14896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:39.749780 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4316c867-b10a-4479-8908-5326cc05c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:39.750904 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Volume 41cf2a15-0d91-4469-9887-1dbb210857f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cf2a15-0d91-4469-9887-1dbb210857f3', 'volume_size': 2}
Sep 06 11:04:39.751548 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] creating volume 'volume-41cf2a15-0d91-4469-9887-1dbb210857f3' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:04:39.763408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:41.353131 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:04:41.353804 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:04:41.358191 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4316c867-b10a-4479-8908-5326cc05c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cf2a15-0d91-4469-9887-1dbb210857f3', 'volume_size': 2}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:41.365129 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab06941d-fd05-498d-8ed9-8a3b22841ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:41.431343 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Volume volume-41cf2a15-0d91-4469-9887-1dbb210857f3 (41cf2a15-0d91-4469-9887-1dbb210857f3): created successfully
Sep 06 11:04:41.437606 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab06941d-fd05-498d-8ed9-8a3b22841ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:41.456011 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Flow 'volume_create_manager' (ce9acf23-f70c-4b20-8543-5a92ce5485c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:04:41.526628 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3d2c4c65-5a36-4c5e-ac71-89f776e2dea2 tempest-VolumesCloneNegativeTest-1586964036 None] Created volume successfully.
Sep 06 11:04:42.891324 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Acquiring lock "cinder-41cf2a15-0d91-4469-9887-1dbb210857f3-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:04:42.953375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Lock "cinder-41cf2a15-0d91-4469-9887-1dbb210857f3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:04:42.968134 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:04:43.089042 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:43.302990 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:04:43.303885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Volume volume-41cf2a15-0d91-4469-9887-1dbb210857f3 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:04:43.492792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] deleting rbd volume volume-41cf2a15-0d91-4469-9887-1dbb210857f3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:04:51.524966 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:04:51.526069 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:51.580565 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:51.614617 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:04:51.617246 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Created reservations ['d3b5bc0b-7d9f-4e34-b511-dcf605c8d117', '2ed533da-354e-4510-9770-0606ab86a08f', '83d14e02-0214-4347-8678-d2cbce0e5e62', 'de5eb4e7-2c11-4688-9e78-18a03ba27e50'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:04:51.859417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:51.921600 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:51.963419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:04:51.967854 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Deleted volume successfully.
Sep 06 11:04:52.090051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-548607db-b21b-4fb1-aa2a-d96cc21ececf tempest-VolumesCloneNegativeTest-1586964036 None] Lock "cinder-41cf2a15-0d91-4469-9887-1dbb210857f3-delete_volume" released by "delete_volume" :: held 9.138s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:04:57.778753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:04:57.804698 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Flow 'volume_create_manager' (221af74b-ce4d-4ae5-9e60-7257f909e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:04:57.814587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff727b18-5149-4d23-987c-f54e522604dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:57.837875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff727b18-5149-4d23-987c-f54e522604dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1308209016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5a587c4-8423-4667-bb8d-b200827f4316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73c9a2dfc994ef4b6a8d7110aeded25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:04:58Z,use_quota=True,user_id='d625fadec55145a3b7906e1d90ff183a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:57.845584 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a09835-fbda-4ec1-b319-e5f3a22d77b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:57.853090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a09835-fbda-4ec1-b319-e5f3a22d77b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:57.858683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe7e5d8-efbb-46e6-9c89-7def869ac3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:57.864189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe7e5d8-efbb-46e6-9c89-7def869ac3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a587c4-8423-4667-bb8d-b200827f4316', 'volume_name': 'volume-f5a587c4-8423-4667-bb8d-b200827f4316', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:57.869066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a7ae85-afae-4c57-bacc-d820bf66af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:57.875057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a7ae85-afae-4c57-bacc-d820bf66af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:57.888371 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59939e9-2560-4ca4-be34-8baa8b0d98c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:57.890443 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Volume f5a587c4-8423-4667-bb8d-b200827f4316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a587c4-8423-4667-bb8d-b200827f4316', 'volume_size': 1}
Sep 06 11:04:57.891104 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] creating volume 'volume-f5a587c4-8423-4667-bb8d-b200827f4316' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:04:57.892065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:04:58.959128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:04:58.978506 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:04:58.978506 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59939e9-2560-4ca4-be34-8baa8b0d98c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a587c4-8423-4667-bb8d-b200827f4316', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:58.980577 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23c3fb1-2892-4f1f-a98f-d44db4d044d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:04:59.117608 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Volume volume-f5a587c4-8423-4667-bb8d-b200827f4316 (f5a587c4-8423-4667-bb8d-b200827f4316): created successfully
Sep 06 11:04:59.117608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23c3fb1-2892-4f1f-a98f-d44db4d044d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:04:59.117608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Flow 'volume_create_manager' (221af74b-ce4d-4ae5-9e60-7257f909e72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:04:59.399675 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c3ca2de5-f984-4bf2-99e9-c058d2f5b6e6 tempest-VolumesSnapshotListTestJSON-1475424769 None] Created volume successfully.
Sep 06 11:05:00.465892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8dec0bc6-8bf5-44af-897d-2a6842baeec5 tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:04.722724 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=42,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:05:04.897471 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8dec0bc6-8bf5-44af-897d-2a6842baeec5 tempest-VolumesSnapshotListTestJSON-1475424769 None] Create snapshot completed successfully
Sep 06 11:05:05.984122 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f0efba47-191f-4f6c-9a02-64e8f3845997 tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:11.039728 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f0efba47-191f-4f6c-9a02-64e8f3845997 tempest-VolumesSnapshotListTestJSON-1475424769 None] Create snapshot completed successfully
Sep 06 11:05:12.857898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a92c5c6d-2f07-4ffa-a47d-6fc23b07efa9 tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:16.899445 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=36,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:05:17.449880 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a92c5c6d-2f07-4ffa-a47d-6fc23b07efa9 tempest-VolumesSnapshotListTestJSON-1475424769 None] Create snapshot completed successfully
Sep 06 11:05:19.309504 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] Acquiring lock "cinder-a1369357-919a-4280-9070-e16b7d17ff78-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:05:19.331475 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-a1369357-919a-4280-9070-e16b7d17ff78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:05:19.373452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:24.766015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] Created reservations ['c4a78732-e5f1-4f4d-bfe9-618c6c784dd9', '672977da-12bf-49af-aedd-a6eb07b32ab3', '8cfffb6a-f4b7-43f6-bf0b-ba35a8f18ef3', '85c21738-8cdb-45ed-a8f1-85ebcf908672'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:05:25.005540 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] Delete snapshot completed successfully.
Sep 06 11:05:25.013691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6c381fdc-5b43-414d-ad17-6c32158370ad tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-a1369357-919a-4280-9070-e16b7d17ff78-delete_snapshot" released by "delete_snapshot" :: held 5.683s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:05:25.793412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] Acquiring lock "cinder-f339027c-1312-403e-91db-d7ee8127fcdb-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:05:25.808851 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-f339027c-1312-403e-91db-d7ee8127fcdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:05:25.811750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:31.159436 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] Created reservations ['69300e26-a056-49b0-b2cf-73c28d41947f', 'e3da1a21-e2c9-407d-932c-ef3e70aa474e', '9ecd3280-7115-4a97-bd24-e9370de93955', '7d87708b-353a-4613-aa15-a008f4109083'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:05:31.456838 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] Delete snapshot completed successfully.
Sep 06 11:05:31.462482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-635d7dff-ac70-46f3-8461-6647fba15793 tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-f339027c-1312-403e-91db-d7ee8127fcdb-delete_snapshot" released by "delete_snapshot" :: held 5.654s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:05:32.195579 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] Acquiring lock "cinder-20470721-20f4-4e9b-930a-5c0de0bb7583-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:05:32.208089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-20470721-20f4-4e9b-930a-5c0de0bb7583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:05:32.208089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:36.814418 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] Created reservations ['c93dcaee-595c-4002-9094-32e40602ec72', '1a9df884-b4da-4843-a7a2-67f3c9fc3c53', '61769b4e-2893-4a0e-bf6a-c0a02188b01f', '54ff21c1-d422-4ac8-8b1c-c9b609d93104'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:05:37.070177 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] Delete snapshot completed successfully.
Sep 06 11:05:37.077244 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5fdfa2c3-777b-40f5-9920-b665d65ca16b tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-20470721-20f4-4e9b-930a-5c0de0bb7583-delete_snapshot" released by "delete_snapshot" :: held 4.871s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:05:37.792985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Acquiring lock "cinder-f5a587c4-8423-4667-bb8d-b200827f4316-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:05:37.814465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-f5a587c4-8423-4667-bb8d-b200827f4316-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:05:37.830137 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=37,cinder:DELETE=2,cinder:UPDATE=20,cinder:INSERT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:05:38.016294 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:38.348760 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:05:38.352639 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Volume volume-f5a587c4-8423-4667-bb8d-b200827f4316 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:05:38.720580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] deleting rbd volume volume-f5a587c4-8423-4667-bb8d-b200827f4316 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:05:47.051118 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Created reservations ['2235567b-8abf-49af-b3b8-da0107d3fcb3', '93e1742e-4d3e-46be-b8f8-a2b9dafcc1ab', 'b4c6e57c-54d9-4fc1-8063-35154aab8c9b', 'fb94f7d7-2a3e-4cca-aa9a-9000b7a1011d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:05:47.355516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:47.394313 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:47.446556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:05:47.451914 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Deleted volume successfully.
Sep 06 11:05:47.549016 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8557401d-281d-409b-a2e9-cdadadf8529c tempest-VolumesSnapshotListTestJSON-1475424769 None] Lock "cinder-f5a587c4-8423-4667-bb8d-b200827f4316-delete_volume" released by "delete_volume" :: held 9.735s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:05:51.526276 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:05:51.527476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:51.576745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:51.621395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:05:56.845878 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:05:56.908481 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Flow 'volume_create_manager' (e18ad15f-4fbd-4fbd-b7de-b4f77abcaeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:05:56.917015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6022a87e-cbeb-4692-aeb3-e2c6fce81da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:56.982363 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=49,cinder:INSERT=11,cinder:UPDATE=24 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:05:56.994376 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6022a87e-cbeb-4692-aeb3-e2c6fce81da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-735887582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e098375f7ed940209832dabbd942c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:05:57Z,use_quota=True,user_id='be22fc68222e497f85bcbaaae4710ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:57.008353 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6aedad-37a5-453c-9943-cb2faf74af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:57.022846 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6aedad-37a5-453c-9943-cb2faf74af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:57.036222 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd2f80b-6289-4061-b9b8-cb0d56cb2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:57.050580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd2f80b-6289-4061-b9b8-cb0d56cb2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0', 'volume_name': 'volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:57.076099 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e16c0c-3158-4ed4-b8bb-cd431a81209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:57.089872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e16c0c-3158-4ed4-b8bb-cd431a81209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:57.099094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6af947e-2433-46a5-b46c-5305977a59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:57.103969 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume 02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0', 'volume_size': 1}
Sep 06 11:05:57.104567 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] creating volume 'volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:05:57.105517 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:05:58.578786 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:05:58.586698 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:05:58.594176 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6af947e-2433-46a5-b46c-5305977a59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:58.615488 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c141a53f-8f85-4dff-8b72-a128e89ed683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:05:58.684352 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0 (02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0): created successfully
Sep 06 11:05:58.688682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c141a53f-8f85-4dff-8b72-a128e89ed683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:05:58.700206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Flow 'volume_create_manager' (e18ad15f-4fbd-4fbd-b7de-b4f77abcaeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:05:58.826733 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fc8c78bb-b73e-415f-9115-f0e7cbcf54a9 tempest-VolumeQuotasAdminTestJSON-195718162 None] Created volume successfully.
Sep 06 11:05:59.257825 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-99668a10-2e15-4182-89c2-43f970470dd4 req-7502fb2d-d831-4ff5-8875-006791a0f633 tempest-ServersTestBootFromVolume-577790625 None] Terminate volume connection completed successfully.
Sep 06 11:05:59.264933 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-99668a10-2e15-4182-89c2-43f970470dd4 req-7502fb2d-d831-4ff5-8875-006791a0f633 tempest-ServersTestBootFromVolume-577790625 None] Deleting attachment a7a95561-2fbb-4633-9a18-57fc1746c44f. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:05:59.858322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Acquiring lock "cinder-99977593-ec2b-460c-ac61-5a8c1aad3dad-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:05:59.902163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Lock "cinder-99977593-ec2b-460c-ac61-5a8c1aad3dad-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:06:00.110396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:00.672198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:06:00.955360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] deleting rbd volume volume-99977593-ec2b-460c-ac61-5a8c1aad3dad {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:06:00.966186 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Acquiring lock "cinder-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:06:00.992815 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Lock "cinder-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:06:01.340237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:01.997415 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:06:01.999149 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:06:02.285916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] deleting rbd volume volume-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:06:10.978460 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=37,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:06:11.204026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Created reservations ['027c45d7-2b10-4788-87eb-7feef67deb45', 'e1a1a6af-f97c-4d76-becc-d6f37a2eb00e', 'e5c1cae1-236d-4b89-a7dd-c03f870fb177', '76fd39ca-4d45-478b-8311-e4c8b572cd61'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:06:11.433423 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:11.547497 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:11.611611 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:06:11.618327 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Deleted volume successfully.
Sep 06 11:06:11.691003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-19c5565a-b554-4198-9161-0530aec36eb2 tempest-VolumeQuotasAdminTestJSON-195718162 None] Lock "cinder-02c9d649-eac6-454b-bf2d-ffd4bfe4bdb0-delete_volume" released by "delete_volume" :: held 10.702s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:06:11.987854 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:06:12.309587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] deleting parent snapshot volume-99977593-ec2b-460c-ac61-5a8c1aad3dad.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:06:16.326650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:06:16.355702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Flow 'volume_create_manager' (ac6f448b-3696-4afc-96a6-1d2cf6ce05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:06:16.368529 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9451f9ec-6ff2-4666-a232-8122c059b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:16.373389 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Created reservations ['e288f78f-7ea9-4428-b2ae-067ab036e830', '99a25678-2bb5-461f-8002-a68e1ec2f392', 'c655d6d5-ffbd-4445-a568-9daa088a0340', 'be07b1fc-f0d9-4d32-b482-bafc60e48ace'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:06:16.399722 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9451f9ec-6ff2-4666-a232-8122c059b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-921666156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e098375f7ed940209832dabbd942c924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:06:13Z,use_quota=True,user_id='be22fc68222e497f85bcbaaae4710ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:16.406604 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4184c-f0d6-4bd9-b9fc-6f0d4c035eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:16.413519 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d4184c-f0d6-4bd9-b9fc-6f0d4c035eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:16.420528 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd4a1f2-313f-497b-bce8-441d3f9e429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:16.424874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd4a1f2-313f-497b-bce8-441d3f9e429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1', 'volume_name': 'volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:16.432449 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd33da-f61c-401b-8b6f-768928831781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:16.436550 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd33da-f61c-401b-8b6f-768928831781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:16.441648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803a8306-1fff-4105-8edf-d86f12aa91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:16.442833 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1', 'volume_size': 1}
Sep 06 11:06:16.443417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] creating volume 'volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:06:16.444614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:16.761088 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:16.928758 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:16.961111 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:06:16.970196 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Deleted volume successfully.
Sep 06 11:06:17.068752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-99668a10-2e15-4182-89c2-43f970470dd4 req-30ad9feb-3ca6-4a77-af98-e8e355772d5a tempest-ServersTestBootFromVolume-577790625 None] Lock "cinder-99977593-ec2b-460c-ac61-5a8c1aad3dad-delete_volume" released by "delete_volume" :: held 17.167s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:06:17.550877 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:06:17.552101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:06:17.556516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803a8306-1fff-4105-8edf-d86f12aa91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:17.566307 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386234db-c179-4e5c-8057-940760cd84f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:17.672217 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Volume volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1 (dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1): created successfully
Sep 06 11:06:17.676257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386234db-c179-4e5c-8057-940760cd84f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:17.685471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Flow 'volume_create_manager' (ac6f448b-3696-4afc-96a6-1d2cf6ce05b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:06:17.923852 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e223f7ab-fe9c-46e5-9b98-24fda14c86dd tempest-VolumeQuotasAdminTestJSON-195718162 None] Created volume successfully.
Sep 06 11:06:20.949207 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-83a5734c-a8c2-4680-8b84-6753c070e768 tempest-VolumeQuotasAdminTestJSON-1220224595 None] Transfer volume completed successfully.
Sep 06 11:06:22.715745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Acquiring lock "cinder-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:06:22.728165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Lock "cinder-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:06:22.858266 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:23.523423 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:06:23.527813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Volume volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:06:23.800483 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] deleting rbd volume volume-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:06:26.983649 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:06:32.203664 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Created reservations ['dc9c8329-946f-42f9-970d-19936db4b904', '652b8ccf-933d-4b3c-8ac5-31dea5fd221f', 'ceff49d2-8892-4937-ae28-57472a38d2ad', '8c56ef81-4187-4558-abaa-b5fe2f7fda95'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:06:32.689950 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:32.776422 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:32.828785 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:06:32.844163 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Deleted volume successfully.
Sep 06 11:06:32.947682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-471034e7-c6a9-47f9-bc85-7df10a614ad7 tempest-VolumeQuotasAdminTestJSON-347733390 None] Lock "cinder-dc782d3e-44fa-4f11-8ee5-fbf1f6076fc1-delete_volume" released by "delete_volume" :: held 10.220s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:06:44.221727 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:06:44.243682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Flow 'volume_create_manager' (e7c26832-c6f9-4a2b-bcc3-d2d272d3dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:06:44.251778 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b6589b-23f2-4fa0-a7ee-5cc6f1aee963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:44.271847 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b6589b-23f2-4fa0-a7ee-5cc6f1aee963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-869098860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b26a202-8891-4bf3-9d30-42d1342c6956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ff4f14a2994086851c71da817aed19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:06:44Z,use_quota=True,user_id='d8d83a8fa74f4b1885f6162b084b4f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:44.285756 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b145ef02-c9a5-48b1-8019-fe2c932d54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:44.291072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b145ef02-c9a5-48b1-8019-fe2c932d54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:44.297212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f876dc-bfb1-405d-8277-c96664f29b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:44.302003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f876dc-bfb1-405d-8277-c96664f29b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b26a202-8891-4bf3-9d30-42d1342c6956', 'volume_name': 'volume-7b26a202-8891-4bf3-9d30-42d1342c6956', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:44.307156 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1f0b16-41c6-4021-abb8-85380673b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:44.311644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1f0b16-41c6-4021-abb8-85380673b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:44.317614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30798dd2-b3f8-4054-81ad-ca8a7ba7c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:44.319243 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Volume 7b26a202-8891-4bf3-9d30-42d1342c6956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b26a202-8891-4bf3-9d30-42d1342c6956', 'volume_size': 1}
Sep 06 11:06:44.319985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] creating volume 'volume-7b26a202-8891-4bf3-9d30-42d1342c6956' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:06:44.322642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:45.360081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:06:45.360791 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:06:45.364099 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30798dd2-b3f8-4054-81ad-ca8a7ba7c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b26a202-8891-4bf3-9d30-42d1342c6956', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:45.368601 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f446a6-3818-463c-814a-f217083504e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:06:45.454288 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Volume volume-7b26a202-8891-4bf3-9d30-42d1342c6956 (7b26a202-8891-4bf3-9d30-42d1342c6956): created successfully
Sep 06 11:06:45.459138 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f446a6-3818-463c-814a-f217083504e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:06:45.463312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Flow 'volume_create_manager' (e7c26832-c6f9-4a2b-bcc3-d2d272d3dd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:06:45.534034 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fed4d13c-c32f-4486-8121-ac4c619accee tempest-AbsoluteLimitsTests-1671663659 None] Created volume successfully.
Sep 06 11:06:46.428962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Acquiring lock "cinder-7b26a202-8891-4bf3-9d30-42d1342c6956-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:06:46.452019 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Lock "cinder-7b26a202-8891-4bf3-9d30-42d1342c6956-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:06:46.582035 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:46.886999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:06:46.887476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Volume volume-7b26a202-8891-4bf3-9d30-42d1342c6956 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:06:47.060710 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] deleting rbd volume volume-7b26a202-8891-4bf3-9d30-42d1342c6956 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:06:51.528899 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:06:51.529563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:51.567190 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:51.616168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:06:54.480425 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:DELETE=2,cinder:SELECT=24,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:06:54.592515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Created reservations ['360ddd7e-6691-4f98-bb50-b46fa82bef17', 'cc20ad2e-0de9-43fc-9bc7-847c520617af', '4cf5876c-5ae1-4457-b216-9bfdbe60eb15', 'c656d2ca-ac24-4dc8-b1db-b42812e237e1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:06:54.809223 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:54.890445 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:06:54.985741 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:06:55.003655 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Deleted volume successfully.
Sep 06 11:06:55.075544 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8b32ae9a-0fdc-4840-bdcf-a42996e4470d tempest-AbsoluteLimitsTests-1671663659 None] Lock "cinder-7b26a202-8891-4bf3-9d30-42d1342c6956-delete_volume" released by "delete_volume" :: held 8.623s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:07:05.003646 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=34,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:07:05.377982 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:07:05.417710 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Flow 'volume_create_manager' (30b83938-04e8-42df-912c-073e134758c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:07:05.424804 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a3d91e-1e5b-48fb-9b87-2b14023101a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:05.450155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a3d91e-1e5b-48fb-9b87-2b14023101a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-343387153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=54509cd9-db99-4041-af65-46fe3fc3aa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534a6b8f7bb04d4e9e3493388bd1d86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:07:05Z,use_quota=True,user_id='86e756626ac4446e907deba71a0ebeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:05.465081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d3398e-2113-437d-960e-9423c7a7d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:05.470294 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d3398e-2113-437d-960e-9423c7a7d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:05.476194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b866a05-675b-4215-bd7f-da9d8ed022f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:05.480983 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b866a05-675b-4215-bd7f-da9d8ed022f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54509cd9-db99-4041-af65-46fe3fc3aa3d', 'volume_name': 'volume-54509cd9-db99-4041-af65-46fe3fc3aa3d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:05.486775 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6817a-fc2e-438a-9a80-ad155384a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:05.489882 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee6817a-fc2e-438a-9a80-ad155384a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:05.495106 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff0c74-01b1-4096-9345-7b83e0ae0c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:05.496209 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Volume 54509cd9-db99-4041-af65-46fe3fc3aa3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54509cd9-db99-4041-af65-46fe3fc3aa3d', 'volume_size': 1}
Sep 06 11:07:05.496610 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] creating volume 'volume-54509cd9-db99-4041-af65-46fe3fc3aa3d' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:07:05.497381 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:07:06.716089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:07:06.716638 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:07:06.720241 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ff0c74-01b1-4096-9345-7b83e0ae0c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54509cd9-db99-4041-af65-46fe3fc3aa3d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:06.724931 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ef255e-fef0-42fc-9d57-0f8f4910a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:07:06.809241 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Volume volume-54509cd9-db99-4041-af65-46fe3fc3aa3d (54509cd9-db99-4041-af65-46fe3fc3aa3d): created successfully
Sep 06 11:07:06.815652 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ef255e-fef0-42fc-9d57-0f8f4910a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:07:06.821927 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Flow 'volume_create_manager' (30b83938-04e8-42df-912c-073e134758c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:07:06.888370 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-77c66ed9-03a3-47d3-bf36-4754a8d8f44b tempest-VolumesActionsTest-968355216 None] Created volume successfully.
Sep 06 11:07:24.629524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aa395f30-4faa-4d9a-878a-e07e897b5c71 tempest-VolumesActionsTest-968355216 None] Acquiring lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" by "attach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:07:24.640378 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aa395f30-4faa-4d9a-878a-e07e897b5c71 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" acquired by "attach_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:07:24.876956 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aa395f30-4faa-4d9a-878a-e07e897b5c71 tempest-VolumesActionsTest-968355216 None] Attaching volume 54509cd9-db99-4041-af65-46fe3fc3aa3d to instance 51c93ad3-522c-4df2-8654-f8ef007b95e2 at mountpoint /dev/sdb on host None.
Sep 06 11:07:25.042500 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aa395f30-4faa-4d9a-878a-e07e897b5c71 tempest-VolumesActionsTest-968355216 None] Attach volume completed successfully.
Sep 06 11:07:25.047398 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aa395f30-4faa-4d9a-878a-e07e897b5c71 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" released by "attach_volume" :: held 0.407s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:07:25.268513 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8853c21f-501e-44e7-8d57-a06b3eb27e4f tempest-VolumesActionsTest-968355216 None] Acquiring lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" by "detach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:07:25.313410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8853c21f-501e-44e7-8d57-a06b3eb27e4f tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:07:25.313904 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8853c21f-501e-44e7-8d57-a06b3eb27e4f tempest-VolumesActionsTest-968355216 None] Detaching volume 54509cd9-db99-4041-af65-46fe3fc3aa3d from instance 51c93ad3-522c-4df2-8654-f8ef007b95e2.
Sep 06 11:07:25.593362 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8853c21f-501e-44e7-8d57-a06b3eb27e4f tempest-VolumesActionsTest-968355216 None] Detach volume completed successfully.
Sep 06 11:07:25.610781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8853c21f-501e-44e7-8d57-a06b3eb27e4f tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" released by "detach_volume" :: held 0.297s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:07:27.073768 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:07:37.063006 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=7,cinder:SELECT=19,cinder:DELETE=1,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:07:47.074200 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:07:51.530480 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:07:51.530480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:07:51.553925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:07:51.579724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:07:54.205126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eeb0bf0c-150c-44c8-9a44-a29e09602a55 tempest-VolumesActionsTest-968355216 None] Acquiring lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" by "attach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:07:54.225446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eeb0bf0c-150c-44c8-9a44-a29e09602a55 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" acquired by "attach_volume" :: waited 0.028s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:07:54.538284 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-eeb0bf0c-150c-44c8-9a44-a29e09602a55 tempest-VolumesActionsTest-968355216 None] Attaching volume 54509cd9-db99-4041-af65-46fe3fc3aa3d to instance 0e879944-3ef1-460a-93cb-8c07843f9996 at mountpoint /dev/sdb on host None.
Sep 06 11:07:54.699537 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-eeb0bf0c-150c-44c8-9a44-a29e09602a55 tempest-VolumesActionsTest-968355216 None] Attach volume completed successfully.
Sep 06 11:07:54.708479 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eeb0bf0c-150c-44c8-9a44-a29e09602a55 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d" released by "attach_volume" :: held 0.484s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:07:54.940729 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f0ba242a-f19a-404f-9c91-ffa5642dfc38 tempest-VolumesActionsTest-968355216 None] Acquiring lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" by "detach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:07:54.951173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f0ba242a-f19a-404f-9c91-ffa5642dfc38 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:07:54.952105 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f0ba242a-f19a-404f-9c91-ffa5642dfc38 tempest-VolumesActionsTest-968355216 None] Detaching volume 54509cd9-db99-4041-af65-46fe3fc3aa3d from instance 0e879944-3ef1-460a-93cb-8c07843f9996.
Sep 06 11:07:55.222803 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f0ba242a-f19a-404f-9c91-ffa5642dfc38 tempest-VolumesActionsTest-968355216 None] Detach volume completed successfully.
Sep 06 11:07:55.232798 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f0ba242a-f19a-404f-9c91-ffa5642dfc38 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-detach_volume" released by "detach_volume" :: held 0.280s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:08:03.270951 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-cab831c6-7f19-4884-804e-4353ed16fbfe tempest-VolumesActionsTest-968355216 None] Running cmd (subprocess): rbd export --pool volumes volume-54509cd9-db99-4041-af65-46fe3fc3aa3d /opt/stack/data/cinder/conversion/volume-54509cd9-db99-4041-af65-46fe3fc3aa3d-678d39a5-7d78-40c0-b902-291665027a11 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:08:04.143695 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-cab831c6-7f19-4884-804e-4353ed16fbfe tempest-VolumesActionsTest-968355216 None] CMD "rbd export --pool volumes volume-54509cd9-db99-4041-af65-46fe3fc3aa3d /opt/stack/data/cinder/conversion/volume-54509cd9-db99-4041-af65-46fe3fc3aa3d-678d39a5-7d78-40c0-b902-291665027a11 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.872s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:08:04.155174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.image_utils [None req-cab831c6-7f19-4884-804e-4353ed16fbfe tempest-VolumesActionsTest-968355216 None] 678d39a5-7d78-40c0-b902-291665027a11 was raw, no need to convert to raw {{(pid=133823) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Sep 06 11:08:17.058819 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:08:27.062167 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:08:36.659794 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cab831c6-7f19-4884-804e-4353ed16fbfe tempest-VolumesActionsTest-968355216 None] Uploaded volume to glance image-id: 678d39a5-7d78-40c0-b902-291665027a11. {{(pid=133823) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}}
Sep 06 11:08:36.775424 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cab831c6-7f19-4884-804e-4353ed16fbfe tempest-VolumesActionsTest-968355216 None] Copy volume to image completed successfully.
Sep 06 11:08:39.690445 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Acquiring lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:08:39.726346 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:08:39.935301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:40.114194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:08:40.115711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Volume volume-54509cd9-db99-4041-af65-46fe3fc3aa3d is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:08:40.307625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] deleting rbd volume volume-54509cd9-db99-4041-af65-46fe3fc3aa3d {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:08:46.677075 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Created reservations ['2a4e73ff-fee0-427e-b9aa-95a0295ff7a7', '88a6fcfa-8272-495c-a768-3a395565b6e4', '7665fff2-406d-4304-9efc-9555865c4238', '31a11f17-6db5-476f-8695-7855671d80a6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:08:46.990531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:47.072866 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:47.240666 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:08:47.270518 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Deleted volume successfully.
Sep 06 11:08:47.275451 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=16,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:08:47.389126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c7f2d09-ba18-473b-9d69-f87d2ef00631 tempest-VolumesActionsTest-968355216 None] Lock "cinder-54509cd9-db99-4041-af65-46fe3fc3aa3d-delete_volume" released by "delete_volume" :: held 7.663s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:08:51.524899 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:08:51.526263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:51.602301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:51.666407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:08:56.870746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:08:56.922873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Flow 'volume_create_manager' (a321a61a-f9f9-4cda-8102-f9cb5923058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:08:56.949438 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8229c827-f009-41ba-8ac0-4fc9383db3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:08:57.014282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8229c827-f009-41ba-8ac0-4fc9383db3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1416469131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=61dd6e63-db91-41b5-9d7e-b13ec7d62728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41a3cc723934533a97db195ae45686c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:08:57Z,use_quota=True,user_id='c8b04240d75543a98980d085263358de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:08:57.027638 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf763d8-dd77-46ca-9792-13dc8c04a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:08:57.040368 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf763d8-dd77-46ca-9792-13dc8c04a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:08:57.064378 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331a7d27-0c90-4ace-84f7-fd7fa9d49a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:08:57.194822 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331a7d27-0c90-4ace-84f7-fd7fa9d49a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61dd6e63-db91-41b5-9d7e-b13ec7d62728', 'volume_name': 'volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7060d8b0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:08:57.215956 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de987b7-9b34-4518-871d-c4fa2381d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:08:57.226161 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de987b7-9b34-4518-871d-c4fa2381d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:08:57.235721 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec99c96b-274e-4f92-aa63-9b7227b63b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:08:57.238031 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Volume 61dd6e63-db91-41b5-9d7e-b13ec7d62728: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7060d8b0>}
Sep 06 11:08:57.239391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Cloning 61dd6e63-db91-41b5-9d7e-b13ec7d62728 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:08:57.241631 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:08:57.262195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:08:57.393279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 8, 57, 271148)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:08:57.405230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:08:57.405230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:08:57.405230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.138s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:08:57.405230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:08:57.415915 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 8, 57, 404714)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:08:57.418887 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:08:57.420236 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:08:57.475652 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:08:57.690782 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] creating snapshot='volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:08:59.522001 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728.clone_snap' to 'volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:09:02.569336 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:09:02.570527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:09:02.570899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:09:03.450053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:09:03.462879 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Marking volume 61dd6e63-db91-41b5-9d7e-b13ec7d62728 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:09:03.462879 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=26,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:09:03.604414 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 61dd6e63-db91-41b5-9d7e-b13ec7d62728. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:09:03.604414 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Creating volume glance metadata for volume 61dd6e63-db91-41b5-9d7e-b13ec7d62728 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:09:03.858097 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec99c96b-274e-4f92-aa63-9b7227b63b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7060d8b0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:03.871363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9c9894-626a-4317-a51c-aec55be83090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:03.991873 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Volume volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728 (61dd6e63-db91-41b5-9d7e-b13ec7d62728): created successfully
Sep 06 11:09:03.997801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9c9894-626a-4317-a51c-aec55be83090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:04.006414 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Flow 'volume_create_manager' (a321a61a-f9f9-4cda-8102-f9cb5923058a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:09:04.125417 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dc79a3df-b866-4963-a425-d957609d71b5 tempest-VolumesExtendTest-706556220 None] Created volume successfully.
Sep 06 11:09:04.704755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19350d40-f9a7-48ce-a2f2-da515db090f9 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:06.786199 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-19350d40-f9a7-48ce-a2f2-da515db090f9 tempest-VolumesExtendTest-706556220 None] Extend volume from 1 GB to 2 GB. {{(pid=133823) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Sep 06 11:09:07.235253 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-19350d40-f9a7-48ce-a2f2-da515db090f9 tempest-VolumesExtendTest-706556220 None] Extend volume completed successfully.
Sep 06 11:09:09.741398 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:09:09.773161 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Flow 'volume_create_manager' (b3008337-03ca-4968-8dce-253a33854e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:09:09.779975 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149ad1a6-7ac3-41bf-96f9-2fea9fd4ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:09.876850 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149ad1a6-7ac3-41bf-96f9-2fea9fd4ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2070237412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd10e52f-5476-4be0-8da1-87ad27a2bbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41a3cc723934533a97db195ae45686c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:09:09Z,use_quota=True,user_id='c8b04240d75543a98980d085263358de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:09.904537 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e204904-6cd2-4f63-a1f1-13993b2a6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:09.916301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e204904-6cd2-4f63-a1f1-13993b2a6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:09.932563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae474c4-b414-46cd-bc51-ccc421600d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:09.937539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae474c4-b414-46cd-bc51-ccc421600d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd10e52f-5476-4be0-8da1-87ad27a2bbde', 'volume_name': 'volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:09.952200 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c1734-6f56-4a2b-aa3e-440340eb033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:09.956853 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c1734-6f56-4a2b-aa3e-440340eb033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:09.963596 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8197d62a-e06d-4541-9e4f-dc31b55e7d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:09.965242 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Volume cd10e52f-5476-4be0-8da1-87ad27a2bbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde', 'volume_size': 1}
Sep 06 11:09:09.965836 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] creating volume 'volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:09:09.966870 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:11.479792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:09:11.484448 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:09:11.484448 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8197d62a-e06d-4541-9e4f-dc31b55e7d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:11.494217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b6ca3-7674-4e93-9c82-5f27eb9d6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:09:11.580114 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Volume volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde (cd10e52f-5476-4be0-8da1-87ad27a2bbde): created successfully
Sep 06 11:09:11.584486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b6ca3-7674-4e93-9c82-5f27eb9d6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:09:11.592985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Flow 'volume_create_manager' (b3008337-03ca-4968-8dce-253a33854e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:09:11.706505 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-23642fef-cb0d-46df-bf8b-d960c2189554 tempest-VolumesExtendTest-706556220 None] Created volume successfully.
Sep 06 11:09:14.174327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4d576acd-f3ff-4cb7-8e65-692d9c6e8c2d tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:19.168865 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4d576acd-f3ff-4cb7-8e65-692d9c6e8c2d tempest-VolumesExtendTest-706556220 None] Create snapshot completed successfully
Sep 06 11:09:20.986513 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d7ab0b27-d71b-4636-9133-7ee848f99a91 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:22.572836 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d7ab0b27-d71b-4636-9133-7ee848f99a91 tempest-VolumesExtendTest-706556220 None] Extend volume from 1 GB to 2 GB. {{(pid=133823) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Sep 06 11:09:22.579468 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=41,cinder:UPDATE=16,cinder:INSERT=12,cinder:DELETE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:09:23.094684 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d7ab0b27-d71b-4636-9133-7ee848f99a91 tempest-VolumesExtendTest-706556220 None] Extend volume completed successfully.
Sep 06 11:09:23.595409 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] Acquiring lock "cinder-016a495e-03ce-4804-a935-63a30ef4b5b7-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:09:23.610999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] Lock "cinder-016a495e-03ce-4804-a935-63a30ef4b5b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:09:23.613101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:27.381830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] Created reservations ['323c1cd7-b7fa-4b55-9674-e0298caa10db', 'f4141a27-db70-4a13-acb1-5f73b5ff5c39', '98ee39d3-33bf-4ddd-920f-d6bf13e67576', '9b58ab3f-759f-4c38-ab11-9ed8cad2697f'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:09:27.842141 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] Delete snapshot completed successfully.
Sep 06 11:09:27.861189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-03f290a3-02be-4349-8e4f-4ff2a15aa8d4 tempest-VolumesExtendTest-706556220 None] Lock "cinder-016a495e-03ce-4804-a935-63a30ef4b5b7-delete_snapshot" released by "delete_snapshot" :: held 4.247s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:09:28.232706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Acquiring lock "cinder-cd10e52f-5476-4be0-8da1-87ad27a2bbde-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:09:28.247363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Lock "cinder-cd10e52f-5476-4be0-8da1-87ad27a2bbde-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:09:28.407350 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:28.684321 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:09:28.684862 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Volume volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:09:29.034191 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] deleting rbd volume volume-cd10e52f-5476-4be0-8da1-87ad27a2bbde {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:09:36.710600 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Created reservations ['a66f472d-6e84-4706-b6e8-416173a05dc0', '0175f3a4-5346-46a6-b873-6b09f7436d2d', 'c6d2158c-ad97-449b-a6bb-2cf4dc08338d', 'b7ea1eb2-0bda-42c1-9656-c7cb7b4f07e0'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:09:36.998149 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:37.090255 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:37.315196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:09:37.323209 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Acquiring lock "cinder-61dd6e63-db91-41b5-9d7e-b13ec7d62728-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:09:37.370176 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Deleted volume successfully.
Sep 06 11:09:37.431419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Lock "cinder-61dd6e63-db91-41b5-9d7e-b13ec7d62728-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:09:37.504316 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2bd4663f-cbbf-438a-81c0-560360996078 tempest-VolumesExtendTest-706556220 None] Lock "cinder-cd10e52f-5476-4be0-8da1-87ad27a2bbde-delete_volume" released by "delete_volume" :: held 9.251s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:09:37.592109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:37.964101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:09:38.137906 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] deleting rbd volume volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:09:46.634505 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:09:46.978140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] deleting parent snapshot volume-61dd6e63-db91-41b5-9d7e-b13ec7d62728.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:09:51.681797 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=43,cinder:UPDATE=26,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:09:51.683771 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:09:51.685124 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:09:51.686040 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:51.801787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:51.906401 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:09:52.318393 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Created reservations ['affedec6-03b0-4579-b3e2-79d4bdaa4922', 'f934ba8f-0d1e-46b8-8268-c2a816d5f277', '47c95b11-19d0-4cde-a865-baa180f369f0', '7a5a1134-778a-42c7-b27d-9644b823174b'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:09:52.641565 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:52.744482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:09:52.820490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:09:52.827117 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Deleted volume successfully.
Sep 06 11:09:52.949936 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fee9e594-65a2-4cc4-aba5-dd31d0373bf6 tempest-VolumesExtendTest-706556220 None] Lock "cinder-61dd6e63-db91-41b5-9d7e-b13ec7d62728-delete_volume" released by "delete_volume" :: held 15.520s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:10:00.462418 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:10:00.512697 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Flow 'volume_create_manager' (4514861b-2c4c-4499-9a43-21cddc220ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:10:00.527417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f33cd06-4aa8-4868-8ed4-958caebd5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:00.556618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f33cd06-4aa8-4868-8ed4-958caebd5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-37989608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887d04ff8eee40e59ec6dd248dd5b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:10:00Z,use_quota=True,user_id='3e45dfaf9fd949548bca37303a117bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:00.563228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aec329-3af1-41d8-9c2b-8d79e774b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:00.576340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aec329-3af1-41d8-9c2b-8d79e774b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:00.583729 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520c8e46-a6dd-455e-8385-ec33e411999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:00.588265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520c8e46-a6dd-455e-8385-ec33e411999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2', 'volume_name': 'volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:00.595272 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bc2d94-46e5-4a1d-99e2-dd6a08dd949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:00.599941 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bc2d94-46e5-4a1d-99e2-dd6a08dd949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:00.605618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e131483-34af-49a7-b64d-3567f504ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:00.606713 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume 1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2', 'volume_size': 1}
Sep 06 11:10:00.607129 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] creating volume 'volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:10:00.608465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:10:01.890265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:10:01.890776 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:10:01.895486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e131483-34af-49a7-b64d-3567f504ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:01.901397 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e25d5e6-f671-4d3c-a32b-ac4b33b2bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:02.004289 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2 (1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2): created successfully
Sep 06 11:10:02.009262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e25d5e6-f671-4d3c-a32b-ac4b33b2bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:02.016876 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Flow 'volume_create_manager' (4514861b-2c4c-4499-9a43-21cddc220ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:10:02.133697 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a56fe6c1-5179-41eb-9e3b-7e84bf337f62 tempest-ServerRescueNegativeTestJSON-836817113 None] Created volume successfully.
Sep 06 11:10:12.139055 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=26,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:10:26.765889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:10:26.825588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Flow 'volume_create_manager' (0e12675b-1cbd-4e36-ad27-6a6d96fcaa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:10:26.826643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f4b208-4ad7-452d-9c9e-e211b02127b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:26.868439 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:10:26.885301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f4b208-4ad7-452d-9c9e-e211b02127b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1460266786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a3210df-d0c2-4ecf-8e6c-945d63b3906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887d04ff8eee40e59ec6dd248dd5b548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:10:26Z,use_quota=True,user_id='3e45dfaf9fd949548bca37303a117bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:26.893008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74adf86f-a75f-4bb1-8bea-d71a140db773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:26.898588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74adf86f-a75f-4bb1-8bea-d71a140db773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:26.906730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e49858-1fa0-44ac-9dd1-effa2cec6fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:26.916348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e49858-1fa0-44ac-9dd1-effa2cec6fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'volume_name': 'volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:26.923833 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca943e2-ec9d-44c4-be3d-461a63ccc8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:26.929008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca943e2-ec9d-44c4-be3d-461a63ccc8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:26.935435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fae270-63f2-4e35-8fae-c046da66a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:26.938171 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume 4a3210df-d0c2-4ecf-8e6c-945d63b3906c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'volume_size': 1}
Sep 06 11:10:26.940232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] creating volume 'volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:10:26.941885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:10:27.710512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:10:27.711154 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:10:27.717895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fae270-63f2-4e35-8fae-c046da66a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:27.727518 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cb463e-6276-45b5-982a-2a4d05374d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:10:27.856732 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c (4a3210df-d0c2-4ecf-8e6c-945d63b3906c): created successfully
Sep 06 11:10:27.862689 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cb463e-6276-45b5-982a-2a4d05374d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:10:27.875874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Flow 'volume_create_manager' (0e12675b-1cbd-4e36-ad27-6a6d96fcaa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:10:28.017633 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f6bca144-9b62-47b7-aa69-d6a0d75c6857 tempest-ServerRescueNegativeTestJSON-836817113 None] Created volume successfully.
Sep 06 11:10:51.681664 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:10:51.682329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:10:51.762208 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:10:51.833558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:10:51.837363 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:10:51.838515 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:11:31.843443 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:11:31.844136 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:11:39.459538 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 req-8022817a-6ff7-43bd-b598-edff9a5d0577 tempest-ServerRescueNegativeTestJSON-836817113 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:11:41.015205 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 req-8022817a-6ff7-43bd-b598-edff9a5d0577 tempest-ServerRescueNegativeTestJSON-836817113 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.567s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:11:41.019330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 req-8022817a-6ff7-43bd-b598-edff9a5d0577 tempest-ServerRescueNegativeTestJSON-836817113 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:11:41.367369 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 req-8022817a-6ff7-43bd-b598-edff9a5d0577 tempest-ServerRescueNegativeTestJSON-836817113 None] Connection info returned from driver {'name': 'volumes/volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4a3210df-d0c2-4ecf-8e6c-945d63b3906c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4fd931a9-6a2b-4efd-88af-19d315c6d7b5'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:11:41.569182 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-d43e1c9a-afa1-48a5-8b5a-6a6af23efe13 req-8022817a-6ff7-43bd-b598-edff9a5d0577 tempest-ServerRescueNegativeTestJSON-836817113 None] attachment_update completed successfully.
Sep 06 11:11:51.684097 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:11:51.687563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:51.792882 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:51.921462 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:11:51.938855 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:11:51.959393 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Flow 'volume_create_manager' (d7183a72-d092-4c0a-b05b-cc60fc17ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:11:51.966573 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a470503-271d-477f-8fe6-706cfe0af57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:51.994382 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a470503-271d-477f-8fe6-706cfe0af57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-474242391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3e37c73-50d7-4ab8-a6a6-05478fd9127a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce0fbcd65bc4a2e8e7d51c9118c8790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:11:52Z,use_quota=True,user_id='0cd4796526324e0ab91d10e1c0b2cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:51.994800 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d9a77f-4e07-4d1d-a079-ce8d205ca04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:51.997568 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d9a77f-4e07-4d1d-a079-ce8d205ca04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:52.002996 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30662be3-b2f0-42d0-9bb1-7b1d39b7412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:52.011071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30662be3-b2f0-42d0-9bb1-7b1d39b7412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e37c73-50d7-4ab8-a6a6-05478fd9127a', 'volume_name': 'volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:52.016879 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762a59b-d020-42e4-bf84-fa9141821ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:52.025980 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762a59b-d020-42e4-bf84-fa9141821ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:52.040269 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93622f4-14af-4839-9e55-fb34c99e429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:52.041983 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Volume f3e37c73-50d7-4ab8-a6a6-05478fd9127a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a', 'volume_size': 1}
Sep 06 11:11:52.042444 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] creating volume 'volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:11:52.046348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:52.681270 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:11:52.682680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:11:52.687930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93622f4-14af-4839-9e55-fb34c99e429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:52.694314 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99535232-9fc5-4478-8bff-a0ffae48b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:11:52.757743 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Volume volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a (f3e37c73-50d7-4ab8-a6a6-05478fd9127a): created successfully
Sep 06 11:11:52.762020 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99535232-9fc5-4478-8bff-a0ffae48b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:11:52.769230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Flow 'volume_create_manager' (d7183a72-d092-4c0a-b05b-cc60fc17ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:11:52.873094 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b423f6d1-2194-4518-81b4-fdb31b230d5a tempest-VolumeQuotasNegativeTestJSON-134847004 None] Created volume successfully.
Sep 06 11:11:55.622984 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Acquiring lock "cinder-f3e37c73-50d7-4ab8-a6a6-05478fd9127a-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:11:55.644034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Lock "cinder-f3e37c73-50d7-4ab8-a6a6-05478fd9127a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:11:55.781904 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:55.943521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:11:55.943984 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Volume volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:11:56.047640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] deleting rbd volume volume-f3e37c73-50d7-4ab8-a6a6-05478fd9127a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:11:59.462254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Created reservations ['20877edd-91bf-4dfb-bb87-d0c722c08b91', '42db9261-017f-4e36-885d-f65a1374e6ea', '1ec23a53-1dd4-4e9f-af70-80a1e902f437', '7154795e-d737-4582-940e-5015a58f15a8'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:11:59.753426 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:59.865202 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:11:59.953425 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:11:59.969997 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Deleted volume successfully.
Sep 06 11:12:00.072298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-530b574a-f5ca-4c94-8fb3-fa0f47aa0136 tempest-VolumeQuotasNegativeTestJSON-134847004 None] Lock "cinder-f3e37c73-50d7-4ab8-a6a6-05478fd9127a-delete_volume" released by "delete_volume" :: held 4.428s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:03.568059 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=36,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:03.570929 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=30,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:03.623487 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-b312462c-09ae-4fdb-802e-4bd2f5386bc1 tempest-TaggedBootDevicesTest-1190023964 None] Terminate volume connection completed successfully.
Sep 06 11:12:03.638363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-b312462c-09ae-4fdb-802e-4bd2f5386bc1 tempest-TaggedBootDevicesTest-1190023964 None] Deleting attachment 0847f6b8-5163-41e1-b447-daf46c628d80. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:12:03.956710 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-d9ed8bf7-10d8-42a1-8532-9adc2cccb3d9 tempest-TaggedBootDevicesTest-1190023964 None] Terminate volume connection completed successfully.
Sep 06 11:12:03.957320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-d9ed8bf7-10d8-42a1-8532-9adc2cccb3d9 tempest-TaggedBootDevicesTest-1190023964 None] Deleting attachment 089373d6-7261-470c-8e10-49c1c81979f2. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:12:04.273816 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-e4906edd-b15a-4629-bd2f-ae8fa39a9597 tempest-TaggedBootDevicesTest-1190023964 None] Terminate volume connection completed successfully.
Sep 06 11:12:04.274239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-664e8b24-ac55-45a4-b1eb-092baf9e54ed req-e4906edd-b15a-4629-bd2f-ae8fa39a9597 tempest-TaggedBootDevicesTest-1190023964 None] Deleting attachment 5b0aec71-70cd-4bf3-8d00-b06f07c5a351. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:12:12.388358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:12:12.429983 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Flow 'volume_create_manager' (d005018a-5c9d-4ed0-8fb5-7cc3ef949421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:12.443901 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4dc39d-6eea-47a6-a760-892cdc841dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:12.487057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4dc39d-6eea-47a6-a760-892cdc841dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-2102192192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=32738ce8-3520-48d2-9b60-1a212d31ba6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a0bc6b4e143ec9a26de6324d54872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:12:12Z,use_quota=True,user_id='98e2f6bf7e414a57ae444a76ac5de059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94c08e9f-652f-4b2c-a2c3-9dfc4ccdac94),volume_type_id=94c08e9f-652f-4b2c-a2c3-9dfc4ccdac94)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:12.500057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d68ce3-e8b3-44d3-b22d-53c31d674c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:12.508866 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d68ce3-e8b3-44d3-b22d-53c31d674c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:12.515667 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e11d487-2b89-4d5f-b309-e461153711d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:12.534971 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e11d487-2b89-4d5f-b309-e461153711d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32738ce8-3520-48d2-9b60-1a212d31ba6d', 'volume_name': 'volume-32738ce8-3520-48d2-9b60-1a212d31ba6d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:12.540015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a932ea-575e-4cd6-9bfa-06d8673bd20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:12.544842 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a932ea-575e-4cd6-9bfa-06d8673bd20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:12.550007 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59509874-1613-4185-80a2-862a21b5c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:12.551352 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Volume 32738ce8-3520-48d2-9b60-1a212d31ba6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32738ce8-3520-48d2-9b60-1a212d31ba6d', 'volume_size': 1}
Sep 06 11:12:12.551925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] creating volume 'volume-32738ce8-3520-48d2-9b60-1a212d31ba6d' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:12:12.553122 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:13.266470 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:12:13.266684 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:12:13.281272 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59509874-1613-4185-80a2-862a21b5c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32738ce8-3520-48d2-9b60-1a212d31ba6d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:13.291586 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f964d8d-a476-45e2-ba52-ef6cafbf088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:13.411579 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Volume volume-32738ce8-3520-48d2-9b60-1a212d31ba6d (32738ce8-3520-48d2-9b60-1a212d31ba6d): created successfully
Sep 06 11:12:13.416406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f964d8d-a476-45e2-ba52-ef6cafbf088f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:13.422920 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Flow 'volume_create_manager' (d005018a-5c9d-4ed0-8fb5-7cc3ef949421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:13.568555 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-21e9e20e-aa79-4c2e-a249-e6016a0524f9 tempest-VolumeTypesTest-187418483 None] Created volume successfully.
Sep 06 11:12:14.211691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Acquiring lock "cinder-97c4f2af-7999-4949-95b8-1d95f5cb1b56-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:14.227550 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-97c4f2af-7999-4949-95b8-1d95f5cb1b56-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:14.356685 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:15.002699 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:15.003384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:15.090764 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] deleting rbd volume volume-97c4f2af-7999-4949-95b8-1d95f5cb1b56 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:15.740092 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2baa579f-b53a-4a5c-b3f4-ad44d1cbf709 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:15.820930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2baa579f-b53a-4a5c-b3f4-ad44d1cbf709 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:15.868592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-2baa579f-b53a-4a5c-b3f4-ad44d1cbf709 tempest-VolumeTypesTest-187418483 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:15.876144 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2baa579f-b53a-4a5c-b3f4-ad44d1cbf709 tempest-VolumeTypesTest-187418483 None] Retype volume completed successfully.
Sep 06 11:12:18.797515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Created reservations ['57da9320-97f5-4cb1-af7c-59f2650a9dd9', '7c41cabc-64c8-45b2-80a6-a4a2f3a8ee6b', '8c276e66-9071-4321-825c-7075bd6c21ff', '6a11ab8c-df49-497d-8f41-427ec829e0d6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:18.927635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Acquiring lock "cinder-32738ce8-3520-48d2-9b60-1a212d31ba6d-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:18.976317 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Lock "cinder-32738ce8-3520-48d2-9b60-1a212d31ba6d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:19.237946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:19.534917 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:19.535835 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Volume volume-32738ce8-3520-48d2-9b60-1a212d31ba6d is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:19.653992 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] deleting rbd volume volume-32738ce8-3520-48d2-9b60-1a212d31ba6d {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:19.657235 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:19.745586 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:19.826179 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:19.837445 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Deleted volume successfully.
Sep 06 11:12:20.110165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-66b5d132-2e29-4532-9d4a-da23566e5a48 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-97c4f2af-7999-4949-95b8-1d95f5cb1b56-delete_volume" released by "delete_volume" :: held 5.882s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:20.219454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Acquiring lock "cinder-6fa4f767-334d-44e6-a00b-ae05aa708fde-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:20.231828 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-6fa4f767-334d-44e6-a00b-ae05aa708fde-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:20.404219 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:20.585518 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:20.590026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Volume volume-6fa4f767-334d-44e6-a00b-ae05aa708fde is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:20.978488 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] deleting rbd volume volume-6fa4f767-334d-44e6-a00b-ae05aa708fde {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:25.617154 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1113414400 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1113414400, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:12:25.618699 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1113414400 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1113414400, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:12:25.793592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Created reservations ['06f7ef33-688b-409e-b5fe-29bac02e4acd', 'f54391ad-c77c-4055-9957-1fb2ee5fa486', 'abe183ee-b3b5-4d66-878c-f81ae668410b', '67091903-b5e9-435c-b59a-8470693566f4'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:26.115452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:26.173429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:26.252934 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:26.258074 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Deleted volume successfully.
Sep 06 11:12:26.354988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9ef6be2b-0d12-4a63-aed6-74a5e6cfd473 tempest-VolumeTypesTest-187418483 None] Lock "cinder-32738ce8-3520-48d2-9b60-1a212d31ba6d-delete_volume" released by "delete_volume" :: held 7.377s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:26.497341 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Created reservations ['16dea1df-2003-4603-ba10-cd0cf8691557', '569f151c-3385-4da0-8085-86fb0dda478d', '8bb4b746-c6ca-4e1b-83a0-d392c7554fce', 'fedba240-9816-40e1-a2b4-e8f0599585a8'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:26.840960 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:26.866465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:26.909694 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:26.915595 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Deleted volume successfully.
Sep 06 11:12:26.921447 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=64,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:26.982262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Acquiring lock "cinder-07bb7589-fa11-4232-8086-c15cca8ad494-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:26.994440 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-07bb7589-fa11-4232-8086-c15cca8ad494-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:27.007316 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=32,cinder:SELECT=58,cinder:INSERT=10 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:27.056506 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-44d0cd06-bcd8-45f5-8b77-b214b9787826 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-6fa4f767-334d-44e6-a00b-ae05aa708fde-delete_volume" released by "delete_volume" :: held 6.824s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:27.302468 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:27.522042 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:27.613089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] deleting rbd volume volume-07bb7589-fa11-4232-8086-c15cca8ad494 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:31.861981 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:12:32.049816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] deleting parent snapshot volume-07bb7589-fa11-4232-8086-c15cca8ad494.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:12:34.537561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Created reservations ['2a8d0eae-420c-4ab6-b98a-719951ca322b', '8f862720-e44e-4793-8f3e-8cbb7e8a1383', '838c0bc2-976c-478c-b123-176fe03c0935', '2f935714-e62e-49a0-b4e4-e20ec78db302'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:34.945931 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:12:34.966216 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (6cd6cc5e-f9de-4160-806c-d118aac5d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:34.972858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f70b24-ce26-4771-b630-31d427199f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:34.976946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:35.002970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:35.035443 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:35.046708 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Deleted volume successfully.
Sep 06 11:12:35.055536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f70b24-ce26-4771-b630-31d427199f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1845909102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6405758a-a7b2-43dd-96a6-f4ea87430e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f98bbe95504e7287b09b7b7e3e5bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:12:35Z,use_quota=True,user_id='5ba0c59a66654f1481b4660c4d1bff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.061540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfbceb8-1028-44fa-8721-70d6620246bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:35.066400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfbceb8-1028-44fa-8721-70d6620246bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.071659 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c472d5-9dc6-4b63-84e2-fb520a19edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:35.076531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c472d5-9dc6-4b63-84e2-fb520a19edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6405758a-a7b2-43dd-96a6-f4ea87430e0e', 'volume_name': 'volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.082666 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77820aea-2470-4def-8283-7db6cec645e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:35.087057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77820aea-2470-4def-8283-7db6cec645e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.092483 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb8d873-bb24-4fa3-812c-3701977540cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:35.093826 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Volume 6405758a-a7b2-43dd-96a6-f4ea87430e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e', 'volume_size': 1}
Sep 06 11:12:35.094385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] creating volume 'volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:12:35.096085 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:35.222742 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-01ef1e18-a62c-4e06-9fc2-50f71f4f7014 tempest-TaggedBootDevicesTest-1190023964 None] Lock "cinder-07bb7589-fa11-4232-8086-c15cca8ad494-delete_volume" released by "delete_volume" :: held 8.229s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:35.579104 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:12:35.579724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:12:35.584230 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb8d873-bb24-4fa3-812c-3701977540cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.589056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b85e0-fbc0-4f16-9266-2dd996d60aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:35.719570 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e (6405758a-a7b2-43dd-96a6-f4ea87430e0e): created successfully
Sep 06 11:12:35.723247 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b85e0-fbc0-4f16-9266-2dd996d60aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:35.730067 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (6cd6cc5e-f9de-4160-806c-d118aac5d753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:35.799516 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-29856861-2a65-43ba-bffa-780956cee71c tempest-VolumesListAdminTestJSON-235226113 None] Created volume successfully.
Sep 06 11:12:37.933588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:12:37.959295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (1a93b5bb-a129-48da-b0ee-088f607e997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:37.969543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17cd256-ffa9-4909-b345-58e10413f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:37.995725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17cd256-ffa9-4909-b345-58e10413f16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-719609096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=08f10dc7-2e41-4671-b1fa-b47e7c13948f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f98bbe95504e7287b09b7b7e3e5bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:12:38Z,use_quota=True,user_id='5ba0c59a66654f1481b4660c4d1bff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.002873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd0d981-f2ff-49a2-b05b-95a55478f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:38.008095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd0d981-f2ff-49a2-b05b-95a55478f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.015825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb984411-558a-4769-a743-547459ecc256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:38.018375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb984411-558a-4769-a743-547459ecc256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f10dc7-2e41-4671-b1fa-b47e7c13948f', 'volume_name': 'volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.024883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dbfc56-0beb-472f-8f4d-ef591dec3467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:38.028600 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dbfc56-0beb-472f-8f4d-ef591dec3467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.033707 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae0271d-db64-428c-9e50-47c69621dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:38.034820 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Volume 08f10dc7-2e41-4671-b1fa-b47e7c13948f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f', 'volume_size': 1}
Sep 06 11:12:38.035233 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] creating volume 'volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:12:38.035883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:38.778343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:12:38.778343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:12:38.779440 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae0271d-db64-428c-9e50-47c69621dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.785739 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815cd03d-cc19-450d-ae0b-fc28f100135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:38.863809 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f (08f10dc7-2e41-4671-b1fa-b47e7c13948f): created successfully
Sep 06 11:12:38.868971 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815cd03d-cc19-450d-ae0b-fc28f100135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:38.873077 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (1a93b5bb-a129-48da-b0ee-088f607e997d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:38.952096 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-79148f09-ce8d-4372-87aa-4028c2b174cb tempest-VolumesListAdminTestJSON-235226113 None] Created volume successfully.
Sep 06 11:12:41.190874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:12:41.209923 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (db12cf19-bda6-42e6-96ba-0fd1ad8ea175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:41.216435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4996b-835e-46ea-a444-d57327be375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.232755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4996b-835e-46ea-a444-d57327be375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-498105992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=08f116fc-fcec-4916-a41a-a31907caa0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f98bbe95504e7287b09b7b7e3e5bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:12:41Z,use_quota=True,user_id='5ba0c59a66654f1481b4660c4d1bff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.241387 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dab5d-fd96-4430-b33e-22262766744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.243322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dab5d-fd96-4430-b33e-22262766744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.249047 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a975164-044c-4460-82b8-b09a6685d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.253093 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a975164-044c-4460-82b8-b09a6685d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f116fc-fcec-4916-a41a-a31907caa0b2', 'volume_name': 'volume-08f116fc-fcec-4916-a41a-a31907caa0b2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.260701 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f61a260-17b6-419a-8e4a-39b7d1000509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.265053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f61a260-17b6-419a-8e4a-39b7d1000509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.269965 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5f8b71-86a1-4c40-a176-cea79e892c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.271289 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Volume 08f116fc-fcec-4916-a41a-a31907caa0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f116fc-fcec-4916-a41a-a31907caa0b2', 'volume_size': 1}
Sep 06 11:12:41.272011 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] creating volume 'volume-08f116fc-fcec-4916-a41a-a31907caa0b2' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:12:41.272850 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:41.805490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:12:41.805877 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:12:41.809634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5f8b71-86a1-4c40-a176-cea79e892c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f116fc-fcec-4916-a41a-a31907caa0b2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.814142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e12b6f-515e-4676-9385-e73c871127e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:41.913798 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-08f116fc-fcec-4916-a41a-a31907caa0b2 (08f116fc-fcec-4916-a41a-a31907caa0b2): created successfully
Sep 06 11:12:41.920017 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e12b6f-515e-4676-9385-e73c871127e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:41.927788 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Flow 'volume_create_manager' (db12cf19-bda6-42e6-96ba-0fd1ad8ea175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:42.042546 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-679e1de0-9cb2-44ca-9520-e52dce8efc98 tempest-VolumesListAdminTestJSON-235226113 None] Created volume successfully.
Sep 06 11:12:44.765436 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:12:44.794166 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Flow 'volume_create_manager' (b3826fed-9a45-4c92-a0c1-e71c14c13f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:44.806295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f0308d-01f1-4405-8394-9f7f5566e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:44.844590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f0308d-01f1-4405-8394-9f7f5566e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca66969b-be67-416c-9321-bbf242774163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b52cfcd46f4fa082e3345f9fbcdc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:12:45Z,use_quota=True,user_id='395f1953379c4e85a72c7c3082e09dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:44.852865 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeb6830-5b06-49fd-bc4f-f1a01b5430c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:44.859790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeb6830-5b06-49fd-bc4f-f1a01b5430c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:44.869119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115f4452-4af6-421b-a933-214aa12e1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:44.875319 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115f4452-4af6-421b-a933-214aa12e1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca66969b-be67-416c-9321-bbf242774163', 'volume_name': 'volume-ca66969b-be67-416c-9321-bbf242774163', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:44.890516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0e7967-32bf-4843-bfa7-f957b6211a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:44.895458 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0e7967-32bf-4843-bfa7-f957b6211a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:44.901564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316dc224-dc65-4e72-ad9a-dddc643ff45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:44.902906 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Volume ca66969b-be67-416c-9321-bbf242774163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca66969b-be67-416c-9321-bbf242774163', 'volume_size': 1}
Sep 06 11:12:44.905870 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] creating volume 'volume-ca66969b-be67-416c-9321-bbf242774163' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:12:44.906660 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:45.611281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:12:45.611281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:12:45.618221 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316dc224-dc65-4e72-ad9a-dddc643ff45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca66969b-be67-416c-9321-bbf242774163', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:45.641814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301dd76-7dd0-4a67-82dc-77461bee189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:12:45.765374 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Volume volume-ca66969b-be67-416c-9321-bbf242774163 (ca66969b-be67-416c-9321-bbf242774163): created successfully
Sep 06 11:12:45.778919 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301dd76-7dd0-4a67-82dc-77461bee189c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:12:45.799277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Flow 'volume_create_manager' (b3826fed-9a45-4c92-a0c1-e71c14c13f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:12:45.930710 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dfed4e58-fe02-4af2-9328-5683de076cff tempest-VolumesListAdminTestJSON-1821329585 None] Created volume successfully.
Sep 06 11:12:47.011446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Acquiring lock "cinder-ca66969b-be67-416c-9321-bbf242774163-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:47.040397 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Lock "cinder-ca66969b-be67-416c-9321-bbf242774163-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:47.182725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:47.476207 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:47.476637 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Volume volume-ca66969b-be67-416c-9321-bbf242774163 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:47.576910 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] deleting rbd volume volume-ca66969b-be67-416c-9321-bbf242774163 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:47.589499 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Acquiring lock "cinder-08f116fc-fcec-4916-a41a-a31907caa0b2-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:47.597501 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-08f116fc-fcec-4916-a41a-a31907caa0b2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:47.739097 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:47.917269 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:47.917269 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-08f116fc-fcec-4916-a41a-a31907caa0b2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:48.090318 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] deleting rbd volume volume-08f116fc-fcec-4916-a41a-a31907caa0b2 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:48.873562 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-207cfdeb-4b1e-40ef-878a-098c7cf05047 req-e8c9da7f-78c3-46b6-9ef6-60088a5c4f7a tempest-ServerRescueNegativeTestJSON-836817113 None] Terminate volume connection completed successfully.
Sep 06 11:12:48.873984 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-207cfdeb-4b1e-40ef-878a-098c7cf05047 req-e8c9da7f-78c3-46b6-9ef6-60088a5c4f7a tempest-ServerRescueNegativeTestJSON-836817113 None] Deleting attachment 4fd931a9-6a2b-4efd-88af-19d315c6d7b5. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:12:51.683515 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:12:51.685968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:51.759126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:51.835477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:53.599066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Created reservations ['4c40ca3c-c5d4-437a-9f8b-150048d0457c', '5a081911-792f-4f58-8516-d9ae1ce186be', 'd278375a-eb06-470d-9897-5c6a34115b14', '326f3a26-c3bd-434b-8b36-6626496e4896'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:53.822204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Created reservations ['52915f4f-c146-4349-aaef-998c5da8d3df', 'e94c20f5-6894-43c2-8194-5b050ecd2822', 'fc3fa188-79ff-4b7e-886c-50a46a1b5f39', '18ca941d-df7d-44aa-9cf7-226343dded14'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:53.949323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:54.007127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:54.185685 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:54.210467 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Deleted volume successfully.
Sep 06 11:12:54.234053 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=31,cinder:SELECT=57,cinder:INSERT=7,cinder:DELETE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:54.350900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-00999a2e-c4b7-424c-baa7-d36f33eeeb38 tempest-VolumesListAdminTestJSON-1821329585 None] Lock "cinder-ca66969b-be67-416c-9321-bbf242774163-delete_volume" released by "delete_volume" :: held 7.310s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:54.366570 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:54.448878 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:54.539295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:54.550130 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Acquiring lock "cinder-08f10dc7-2e41-4671-b1fa-b47e7c13948f-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:54.556775 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Deleted volume successfully.
Sep 06 11:12:54.585198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-08f10dc7-2e41-4671-b1fa-b47e7c13948f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:54.683867 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8c3ae811-45bd-4833-8853-7e02c25ba868 tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-08f116fc-fcec-4916-a41a-a31907caa0b2-delete_volume" released by "delete_volume" :: held 7.086s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:54.811047 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:12:54.819985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:55.008456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:55.008456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:12:55.170589 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] deleting rbd volume volume-08f10dc7-2e41-4671-b1fa-b47e7c13948f {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:12:58.491595 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Created reservations ['8d44d854-fa4e-4cc1-8576-0577e529d8fd', 'bf2f8933-8ed8-4441-a4f3-62a84fbe4a52', 'e9ffe5f6-731e-49df-a4a8-b5b2c49275a7', '3717695f-39d9-4cb0-bbeb-d4ae0bdafdbb'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:12:58.739505 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:58.830358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:58.944236 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:12:58.960637 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Deleted volume successfully.
Sep 06 11:12:59.088327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f95a7ca4-ed7e-4303-b8ec-5bafc0b9479c tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-08f10dc7-2e41-4671-b1fa-b47e7c13948f-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:12:59.376608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Acquiring lock "cinder-6405758a-a7b2-43dd-96a6-f4ea87430e0e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:12:59.392715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-6405758a-a7b2-43dd-96a6-f4ea87430e0e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:12:59.570982 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:12:59.825445 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:12:59.826969 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Volume volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:13:00.005549 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] deleting rbd volume volume-6405758a-a7b2-43dd-96a6-f4ea87430e0e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:13:02.612839 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Acquiring lock "cinder-4a3210df-d0c2-4ecf-8e6c-945d63b3906c-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:13:02.647608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Lock "cinder-4a3210df-d0c2-4ecf-8e6c-945d63b3906c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:13:02.848530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:03.052387 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:13:03.052815 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Volume volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:13:03.205566 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] deleting rbd volume volume-4a3210df-d0c2-4ecf-8e6c-945d63b3906c {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:13:03.391135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Created reservations ['b0f86110-04a7-4869-82ae-2c7c719be62f', '1f02f9aa-18cf-4c93-9a3f-fd04221fdcb7', 'c48a2c01-7120-411f-b0a1-edbfaab34689', 'e26d21b2-6b2e-4967-9fa7-661d7a3dce7d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:13:03.687982 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:03.783800 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:03.845728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:13:03.853376 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Deleted volume successfully.
Sep 06 11:13:04.005532 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6a4a94c4-10c2-4d27-b53c-91b8e6e4ec77 tempest-VolumesListAdminTestJSON-235226113 None] Lock "cinder-6405758a-a7b2-43dd-96a6-f4ea87430e0e-delete_volume" released by "delete_volume" :: held 4.617s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:13:06.634331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Created reservations ['3e77bb24-0cea-4ba8-96a3-dedb7709ac88', 'e41bb4bc-e09c-46fb-b5ca-4e0164a7e63c', '471b0d91-b30a-4c81-b11e-165815864ffa', 'f7adead3-1d25-4160-95fa-3239a1fb43d4'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:13:06.992365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:07.039417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:07.104432 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:13:07.112111 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Deleted volume successfully.
Sep 06 11:13:07.240725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7df5a87f-871d-4067-9f74-8c994e2983bc tempest-ServerRescueNegativeTestJSON-836817113 None] Lock "cinder-4a3210df-d0c2-4ecf-8e6c-945d63b3906c-delete_volume" released by "delete_volume" :: held 4.591s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:13:07.570189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Acquiring lock "cinder-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:13:07.594561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Lock "cinder-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:13:07.755159 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:07.906991 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:13:07.907632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Volume volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:13:07.993898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] deleting rbd volume volume-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:13:10.966962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Created reservations ['ee1c30a4-bb58-4f7f-a693-4d99c4b0a503', '9855fefb-557e-41f2-be67-63d1ebab6177', 'acb3a845-ab38-47e0-b023-e9078044f785', 'd5fa7e41-2a58-4085-8801-54c538385151'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:13:11.078116 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:13:11.239364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:11.299744 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:11.448030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:13:11.457935 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Deleted volume successfully.
Sep 06 11:13:11.560173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c04af9ae-f743-451a-92c3-c21c12ce67d8 tempest-ServerRescueNegativeTestJSON-836817113 None] Lock "cinder-1d4ad37e-1d43-4a0f-b61e-6d1ab43acda2-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:13:21.047977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:13:21.156682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (9e46f7c1-e4cd-4ead-bd9d-8e32adbf7049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:21.169516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca070e34-08aa-43d8-a935-046896ec7ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:21.187686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca070e34-08aa-43d8-a935-046896ec7ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-912161358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ddeb12fb-7b7d-4d13-87e2-c22de50bf482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cea8e2c3b9438ea6a50fb852468a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:13:21Z,use_quota=True,user_id='36f490bcb6d643fa99b73ffa55d37c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:21.194368 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02336fa-1c3e-4606-abf2-80eae59f4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:21.199928 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02336fa-1c3e-4606-abf2-80eae59f4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:21.205413 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c97857-9888-41a2-ac31-bbbd658a4c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:21.312431 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c97857-9888-41a2-ac31-bbbd658a4c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'volume_name': 'volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a709636a0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:21.321558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4063cb4-dac6-4b21-8026-b786726e96c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:21.326583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4063cb4-dac6-4b21-8026-b786726e96c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:21.331939 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5bf08-ef19-4f5a-bb5f-9f64fab6622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:21.333531 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Volume ddeb12fb-7b7d-4d13-87e2-c22de50bf482: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a709636a0>}
Sep 06 11:13:21.334380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Cloning ddeb12fb-7b7d-4d13-87e2-c22de50bf482 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:13:21.337209 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:13:21.360797 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:13:21.514903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 13, 21, 352780)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:13:21.517868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:13:21.518415 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:13:21.538267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.189s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:13:21.539120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:13:21.681863 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 13, 21, 545141)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:13:21.686909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:13:21.687694 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:13:21.718947 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:22.012019 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] creating snapshot='volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:13:23.651327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482.clone_snap' to 'volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:13:24.871206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:13:24.873234 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:13:24.873793 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:13:25.269310 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:13:25.269900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Marking volume ddeb12fb-7b7d-4d13-87e2-c22de50bf482 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:13:25.406248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to ddeb12fb-7b7d-4d13-87e2-c22de50bf482. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:13:25.406248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Creating volume glance metadata for volume ddeb12fb-7b7d-4d13-87e2-c22de50bf482 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:13:25.666256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5bf08-ef19-4f5a-bb5f-9f64fab6622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a709636a0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:25.676936 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78e0700-17f3-4d35-8d9f-a41aebd00a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:25.841049 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482 (ddeb12fb-7b7d-4d13-87e2-c22de50bf482): created successfully
Sep 06 11:13:25.846060 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78e0700-17f3-4d35-8d9f-a41aebd00a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:25.855871 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (9e46f7c1-e4cd-4ead-bd9d-8e32adbf7049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:26.045021 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cc05386c-fc11-424d-9e31-23aeeb9b37ec tempest-TaggedBootDevicesTest_v242-571015205 None] Created volume successfully.
Sep 06 11:13:27.691766 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=56,cinder:UPDATE=37,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:13:27.859284 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:13:27.881030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (dd02d8ec-5c85-4e4a-b912-7b092c908ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:27.889506 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da6c5c2-8390-4324-ada9-aa99682fc183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:27.980058 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da6c5c2-8390-4324-ada9-aa99682fc183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-89469975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cfc1bca-12f4-436b-8059-29691621750d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cea8e2c3b9438ea6a50fb852468a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:13:28Z,use_quota=True,user_id='36f490bcb6d643fa99b73ffa55d37c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:27.997232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd87124-adc8-466d-9d25-fe74991c22fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:28.017702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd87124-adc8-466d-9d25-fe74991c22fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:28.029209 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de348d7e-c419-430c-a416-d04cf1addcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:28.051765 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de348d7e-c419-430c-a416-d04cf1addcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfc1bca-12f4-436b-8059-29691621750d', 'volume_name': 'volume-1cfc1bca-12f4-436b-8059-29691621750d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:28.077985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48758c21-31c6-4030-ae2b-2d9eddcbd7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:28.094605 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48758c21-31c6-4030-ae2b-2d9eddcbd7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:28.103949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed12ab6b-10bc-4139-b3f6-ff06664eaa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:28.105499 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Volume 1cfc1bca-12f4-436b-8059-29691621750d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfc1bca-12f4-436b-8059-29691621750d', 'volume_size': 1}
Sep 06 11:13:28.106042 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] creating volume 'volume-1cfc1bca-12f4-436b-8059-29691621750d' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:13:28.107760 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:28.660155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:13:28.661033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:13:28.667362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed12ab6b-10bc-4139-b3f6-ff06664eaa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfc1bca-12f4-436b-8059-29691621750d', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:28.683778 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363dbfe-e050-4e7d-979e-3804ae966922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:28.792280 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-1cfc1bca-12f4-436b-8059-29691621750d (1cfc1bca-12f4-436b-8059-29691621750d): created successfully
Sep 06 11:13:28.797580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363dbfe-e050-4e7d-979e-3804ae966922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:28.816162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (dd02d8ec-5c85-4e4a-b912-7b092c908ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:28.977866 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b6fa38cd-d6f4-45ee-b59a-ff694ce05a44 tempest-TaggedBootDevicesTest_v242-571015205 None] Created volume successfully.
Sep 06 11:13:31.198319 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:13:31.247943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (058277d9-998e-4ceb-8e03-4453096c7cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:31.269473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bc8547-1943-4978-898b-76f8d512cb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.288551 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bc8547-1943-4978-898b-76f8d512cb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1640559069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=94a3ca98-6ae6-4403-ac62-4a263bac123e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cea8e2c3b9438ea6a50fb852468a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:13:31Z,use_quota=True,user_id='36f490bcb6d643fa99b73ffa55d37c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.294814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4b9a71-479f-46fa-8b5e-24384bec32a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.299829 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4b9a71-479f-46fa-8b5e-24384bec32a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.318307 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3da7f06-d349-4f4d-ab30-2b4ff62f6494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.337417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3da7f06-d349-4f4d-ab30-2b4ff62f6494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a3ca98-6ae6-4403-ac62-4a263bac123e', 'volume_name': 'volume-94a3ca98-6ae6-4403-ac62-4a263bac123e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.337417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d92e815-387a-4a90-bc8e-b2a969722cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.337417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d92e815-387a-4a90-bc8e-b2a969722cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.341608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e010084-faaa-4a4c-a34b-94fa52b308a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.346020 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Volume 94a3ca98-6ae6-4403-ac62-4a263bac123e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a3ca98-6ae6-4403-ac62-4a263bac123e', 'volume_size': 1}
Sep 06 11:13:31.346556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] creating volume 'volume-94a3ca98-6ae6-4403-ac62-4a263bac123e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:13:31.347362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:31.788742 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:13:31.789294 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:13:31.793486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e010084-faaa-4a4c-a34b-94fa52b308a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a3ca98-6ae6-4403-ac62-4a263bac123e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.802735 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236743e0-3882-446f-ac75-034e27438118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:13:31.957788 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-94a3ca98-6ae6-4403-ac62-4a263bac123e (94a3ca98-6ae6-4403-ac62-4a263bac123e): created successfully
Sep 06 11:13:31.962954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236743e0-3882-446f-ac75-034e27438118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:13:31.970128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Flow 'volume_create_manager' (058277d9-998e-4ceb-8e03-4453096c7cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:13:32.055480 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-79c1d737-c0c7-456e-a079-8c3c768f6e3f tempest-TaggedBootDevicesTest_v242-571015205 None] Created volume successfully.
Sep 06 11:13:44.550631 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=36,cinder:UPDATE=10,cinder:INSERT=11,cinder:DELETE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:13:51.683241 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:13:51.686993 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:51.841501 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:13:52.010918 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:13:54.564356 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:14:00.447746 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-6836ce64-cf67-4d83-bbc3-5b10db09f0de tempest-TaggedBootDevicesTest_v242-571015205 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:14:01.589048 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-6836ce64-cf67-4d83-bbc3-5b10db09f0de tempest-TaggedBootDevicesTest_v242-571015205 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.141s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:14:01.589894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-6836ce64-cf67-4d83-bbc3-5b10db09f0de tempest-TaggedBootDevicesTest_v242-571015205 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:14:01.708757 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-6836ce64-cf67-4d83-bbc3-5b10db09f0de tempest-TaggedBootDevicesTest_v242-571015205 None] Connection info returned from driver {'name': 'volumes/volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ddeb12fb-7b7d-4d13-87e2-c22de50bf482', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bb708106-3919-4d79-abc2-bfb0a052c7e2'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:14:01.875624 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-6836ce64-cf67-4d83-bbc3-5b10db09f0de tempest-TaggedBootDevicesTest_v242-571015205 None] attachment_update completed successfully.
Sep 06 11:14:03.632654 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-3abb8987-1d50-4f64-a1bb-49b544ace75c tempest-TaggedBootDevicesTest_v242-571015205 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:14:04.692219 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-3abb8987-1d50-4f64-a1bb-49b544ace75c tempest-TaggedBootDevicesTest_v242-571015205 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.058s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:14:04.693590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-3abb8987-1d50-4f64-a1bb-49b544ace75c tempest-TaggedBootDevicesTest_v242-571015205 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1cfc1bca-12f4-436b-8059-29691621750d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '1cfc1bca-12f4-436b-8059-29691621750d', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:14:04.841708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-3abb8987-1d50-4f64-a1bb-49b544ace75c tempest-TaggedBootDevicesTest_v242-571015205 None] Connection info returned from driver {'name': 'volumes/volume-1cfc1bca-12f4-436b-8059-29691621750d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1cfc1bca-12f4-436b-8059-29691621750d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6b63df47-e9f6-458c-94c8-76d740b40e79'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:14:05.069706 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-3abb8987-1d50-4f64-a1bb-49b544ace75c tempest-TaggedBootDevicesTest_v242-571015205 None] attachment_update completed successfully.
Sep 06 11:14:06.954359 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-1c19ada3-4b23-4e37-ad6a-f221563c5563 tempest-TaggedBootDevicesTest_v242-571015205 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:14:08.317988 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-1c19ada3-4b23-4e37-ad6a-f221563c5563 tempest-TaggedBootDevicesTest_v242-571015205 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.364s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:14:08.318880 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-1c19ada3-4b23-4e37-ad6a-f221563c5563 tempest-TaggedBootDevicesTest_v242-571015205 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-94a3ca98-6ae6-4403-ac62-4a263bac123e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '94a3ca98-6ae6-4403-ac62-4a263bac123e', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:14:08.477267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-1c19ada3-4b23-4e37-ad6a-f221563c5563 tempest-TaggedBootDevicesTest_v242-571015205 None] Connection info returned from driver {'name': 'volumes/volume-94a3ca98-6ae6-4403-ac62-4a263bac123e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '94a3ca98-6ae6-4403-ac62-4a263bac123e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '99ad532b-5cd4-45eb-b75c-0723ef507238'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:14:08.757511 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b8df9a26-cba5-4194-b9c3-7442a2ccfec5 req-1c19ada3-4b23-4e37-ad6a-f221563c5563 tempest-TaggedBootDevicesTest_v242-571015205 None] attachment_update completed successfully.
Sep 06 11:14:15.081027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:15.110868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Flow 'volume_create_manager' (e08bd15d-15ca-4742-a687-fab8115432a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:15.120014 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bf6c73-79a5-4163-99e3-fcca1715dd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.138437 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bf6c73-79a5-4163-99e3-fcca1715dd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-190050042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8abfe24d-11af-49da-a532-321675d143d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='041b07c4e3dd4a88b18646126981b420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:15Z,use_quota=True,user_id='8c33476cb26f4a2fb575cdcd03e97269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.144586 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a6c188-2b8d-481a-8ef4-ff897fc3008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.149116 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a6c188-2b8d-481a-8ef4-ff897fc3008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.154315 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da3202-b47a-40e3-b5b8-6e7fa9c95198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.158372 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da3202-b47a-40e3-b5b8-6e7fa9c95198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abfe24d-11af-49da-a532-321675d143d9', 'volume_name': 'volume-8abfe24d-11af-49da-a532-321675d143d9', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.165098 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2407a8-56ff-490d-abcc-67de4d1d7b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.169472 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2407a8-56ff-490d-abcc-67de4d1d7b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.180177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045b09f3-0891-44ae-81b4-63e5a0c64b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.180177 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Volume 8abfe24d-11af-49da-a532-321675d143d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abfe24d-11af-49da-a532-321675d143d9', 'volume_size': 1}
Sep 06 11:14:15.180177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] creating volume 'volume-8abfe24d-11af-49da-a532-321675d143d9' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:15.180177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:15.733482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:15.733482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:15.737485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045b09f3-0891-44ae-81b4-63e5a0c64b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abfe24d-11af-49da-a532-321675d143d9', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.745408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b533e7-3754-40c3-b1fb-4934cb184aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:15.930642 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Volume volume-8abfe24d-11af-49da-a532-321675d143d9 (8abfe24d-11af-49da-a532-321675d143d9): created successfully
Sep 06 11:14:15.966630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b533e7-3754-40c3-b1fb-4934cb184aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:15.967389 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Flow 'volume_create_manager' (e08bd15d-15ca-4742-a687-fab8115432a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:16.261268 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-c4b0d9d7-7624-4d4c-a8b0-d963bcb5371d req-ad83805a-db89-472e-9457-18cdf2592ece tempest-VolumesGetTestJSON-714361466 None] Created volume successfully.
Sep 06 11:14:17.334492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Acquiring lock "cinder-8abfe24d-11af-49da-a532-321675d143d9-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:14:17.397839 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Lock "cinder-8abfe24d-11af-49da-a532-321675d143d9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:14:17.533258 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:17.821331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:14:17.821777 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Volume volume-8abfe24d-11af-49da-a532-321675d143d9 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:14:17.925515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] deleting rbd volume volume-8abfe24d-11af-49da-a532-321675d143d9 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:14:21.329927 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=47,cinder:UPDATE=7 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:14:21.442683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Created reservations ['f40e0d0d-568f-49ce-b8a6-d57f698d6cea', 'bd31e09f-d1bc-4f16-98c3-372423713a95', '8f8e7b59-4ed0-46ca-a57e-eff055ba8341', '75de42d1-ac8d-4409-ba8f-370e6e20b579'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:14:21.758514 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:21.804640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:21.891253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:14:21.917401 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Deleted volume successfully.
Sep 06 11:14:22.003967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-6b9228f1-bbe4-4cf9-b5ab-f0dc425ba2d5 req-884e788a-e1e7-4329-9b0d-dd39fbacef2f tempest-VolumesGetTestJSON-714361466 None] Lock "cinder-8abfe24d-11af-49da-a532-321675d143d9-delete_volume" released by "delete_volume" :: held 4.609s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:14:27.143819 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=60,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:14:27.211406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:27.232877 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (0d03d3ef-c019-42e4-95fe-5cd6474ef799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:27.239721 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f137f26a-124b-413d-b04e-1f95616e2d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:27.257167 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f137f26a-124b-413d-b04e-1f95616e2d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-191512545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=91c4e502-8673-46bd-8d12-3595c5eaddf7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f629267070cc4308b78648f7e77115ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:27Z,use_quota=True,user_id='2df22ffde8d441e89515b1af1856bac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:27.262446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb8c558-43e0-442c-bb6d-83325fd0f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:27.266747 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb8c558-43e0-442c-bb6d-83325fd0f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:27.272521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c660b-b65b-40dd-bcca-7c83c8800530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:27.277395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948c660b-b65b-40dd-bcca-7c83c8800530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c4e502-8673-46bd-8d12-3595c5eaddf7', 'volume_name': 'volume-91c4e502-8673-46bd-8d12-3595c5eaddf7', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:27.282318 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23311c80-0ea1-4d95-843f-4b81a7398f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:27.289553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23311c80-0ea1-4d95-843f-4b81a7398f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:27.291175 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd0b7b-03ce-41e8-9c9d-a5abbebf8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:27.292336 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Volume 91c4e502-8673-46bd-8d12-3595c5eaddf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c4e502-8673-46bd-8d12-3595c5eaddf7', 'volume_size': 1}
Sep 06 11:14:27.292740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] creating volume 'volume-91c4e502-8673-46bd-8d12-3595c5eaddf7' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:27.293708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:27.918989 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:27.924428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:27.924428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd0b7b-03ce-41e8-9c9d-a5abbebf8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c4e502-8673-46bd-8d12-3595c5eaddf7', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:27.928820 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b108d83a-2cf0-419a-945c-4a45096b5788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:28.036820 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Volume volume-91c4e502-8673-46bd-8d12-3595c5eaddf7 (91c4e502-8673-46bd-8d12-3595c5eaddf7): created successfully
Sep 06 11:14:28.041089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b108d83a-2cf0-419a-945c-4a45096b5788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:28.047477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (0d03d3ef-c019-42e4-95fe-5cd6474ef799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:28.137206 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c80a7c5c-4d78-46a9-b3a8-c575f50e6f01 tempest-VolumesTestJSON-1367246480 None] Created volume successfully.
Sep 06 11:14:30.561790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:30.601999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (ccfa01de-ffd4-464e-b2f1-e12d1f25bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:30.638123 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e375dfce-5b98-4758-b435-b03579a3a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:30.687415 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e375dfce-5b98-4758-b435-b03579a3a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1217859646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=30935d4c-75ad-4523-8d7b-f3af40c1d91e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f629267070cc4308b78648f7e77115ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:30Z,use_quota=True,user_id='2df22ffde8d441e89515b1af1856bac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:30.699101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90372eb-f6a5-4c1c-8d50-725b386c183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:30.707703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90372eb-f6a5-4c1c-8d50-725b386c183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:30.727170 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafc6524-a1ca-449d-b54f-c093cc1693c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:30.759580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafc6524-a1ca-449d-b54f-c093cc1693c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30935d4c-75ad-4523-8d7b-f3af40c1d91e', 'volume_name': 'volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:30.789435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ea5ed-e0fa-41a6-b31f-ba641db7e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:30.799603 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ea5ed-e0fa-41a6-b31f-ba641db7e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:30.806963 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269e9771-b0f9-4cc6-b4b2-7b9b1583f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:30.809026 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Volume 30935d4c-75ad-4523-8d7b-f3af40c1d91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e', 'volume_size': 1}
Sep 06 11:14:30.809622 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] creating volume 'volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:30.810531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:31.306159 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:31.307312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:31.316293 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269e9771-b0f9-4cc6-b4b2-7b9b1583f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:31.330360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751884dc-e9f3-4f50-925a-c8105a08eff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:31.430258 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Volume volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e (30935d4c-75ad-4523-8d7b-f3af40c1d91e): created successfully
Sep 06 11:14:31.434854 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751884dc-e9f3-4f50-925a-c8105a08eff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:31.446057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (ccfa01de-ffd4-464e-b2f1-e12d1f25bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:31.558229 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ae364d40-120e-44f0-8691-61f25cd4cc53 tempest-VolumesTestJSON-1367246480 None] Created volume successfully.
Sep 06 11:14:33.705378 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:33.759770 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (1e4806b5-0920-4ea0-ad91-6eb135e41da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:33.771442 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707d6804-0c01-472e-ad83-89043f75cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:33.812170 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707d6804-0c01-472e-ad83-89043f75cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-610115719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f629267070cc4308b78648f7e77115ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:33Z,use_quota=True,user_id='2df22ffde8d441e89515b1af1856bac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:33.818218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe10e36-ac5e-4616-9ff9-ef799016c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:33.833484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe10e36-ac5e-4616-9ff9-ef799016c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:33.841081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657080e-f55e-4194-9f38-93b3b7371e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:33.847850 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0657080e-f55e-4194-9f38-93b3b7371e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab', 'volume_name': 'volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:33.854889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794f320-0b21-426c-9f71-bf2cec7edb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:33.859543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794f320-0b21-426c-9f71-bf2cec7edb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:33.869371 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1bee97-bad3-41d1-9ecd-c615d0818a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:33.870574 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Volume 7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab', 'volume_size': 1}
Sep 06 11:14:33.870983 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] creating volume 'volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:33.871686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:34.488112 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:34.488485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:34.492509 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1bee97-bad3-41d1-9ecd-c615d0818a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:34.498225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b20638-cad1-4599-b131-de62fe0cd72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:34.584107 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Volume volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab (7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab): created successfully
Sep 06 11:14:34.596457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b20638-cad1-4599-b131-de62fe0cd72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:34.612885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Flow 'volume_create_manager' (1e4806b5-0920-4ea0-ad91-6eb135e41da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:34.698546 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-06114e96-d593-4cb1-993f-e63f974e1cd8 tempest-VolumesTestJSON-1367246480 None] Created volume successfully.
Sep 06 11:14:38.216869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Acquiring lock "cinder-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:14:38.238085 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Lock "cinder-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:14:38.386737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:38.516454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:14:38.516883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Volume volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:14:38.575849 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] deleting rbd volume volume-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:14:42.673706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Created reservations ['e53ea0f3-0b60-48ab-a487-bd4f06dbe3f7', '9ba8db19-c1ea-4206-b1b7-af56ec48467c', '820fe879-c8d7-4501-a1df-386b42f2fe22', '7f57ff84-1c31-4ead-aaa6-70930edef69d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:14:42.984399 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:43.136872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:43.224907 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:14:43.238519 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Deleted volume successfully.
Sep 06 11:14:43.342198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-67207c60-abb2-4c65-a02b-e7eb88eec7bb tempest-VolumesTestJSON-1367246480 None] Lock "cinder-7d3d91c2-6b5f-45e5-b5ed-ba93fa1977ab-delete_volume" released by "delete_volume" :: held 5.108s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:14:44.036202 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Acquiring lock "cinder-30935d4c-75ad-4523-8d7b-f3af40c1d91e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:14:44.069541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Lock "cinder-30935d4c-75ad-4523-8d7b-f3af40c1d91e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:14:44.231644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:44.412587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:14:44.416894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Volume volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:14:44.504465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] deleting rbd volume volume-30935d4c-75ad-4523-8d7b-f3af40c1d91e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:14:47.646043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:47.660433 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Flow 'volume_create_manager' (264afb2c-f74c-4e1e-a86d-92c079e17dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:47.667528 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec709c4-0e18-41d8-a3e4-5b138fa3debf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:47.686669 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec709c4-0e18-41d8-a3e4-5b138fa3debf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2096986296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=20ad1fa0-c584-4591-bb6f-e9158e7f61ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad114c7a41a47e785fd117e1103f168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:47Z,use_quota=True,user_id='3e904f27c02248389ae9ca86cb95c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:47.700340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeac571-3737-4b3c-9eed-ea64772425e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:47.700340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeac571-3737-4b3c-9eed-ea64772425e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:47.703163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7b4f95-3803-45c5-9e58-7b0b1cc93860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:47.708253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7b4f95-3803-45c5-9e58-7b0b1cc93860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ad1fa0-c584-4591-bb6f-e9158e7f61ee', 'volume_name': 'volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:47.713178 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdc5c4-304a-42b7-bfe9-e3afa9f63a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:47.717283 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdc5c4-304a-42b7-bfe9-e3afa9f63a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:47.722702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fb07b-41b7-41d0-9864-937d9c960a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:47.723982 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Volume 20ad1fa0-c584-4591-bb6f-e9158e7f61ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee', 'volume_size': 1}
Sep 06 11:14:47.724469 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] creating volume 'volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:47.725325 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:48.656194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:48.658085 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:48.660709 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fb07b-41b7-41d0-9864-937d9c960a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:48.667801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae03e21a-de96-41b0-b607-bf409f46f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:48.708348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Created reservations ['8ea3b7ad-e1a0-4ce3-8477-109e7586b3d9', 'bb64d25c-152a-4bc3-9bce-34286382c661', '1c4e2445-ff88-4a94-a123-2d4ecc1a6a50', '213f7d06-3825-4f67-b31d-b1f6cce5d072'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:14:48.757901 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Volume volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee (20ad1fa0-c584-4591-bb6f-e9158e7f61ee): created successfully
Sep 06 11:14:48.761465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae03e21a-de96-41b0-b607-bf409f46f358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:48.766899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Flow 'volume_create_manager' (264afb2c-f74c-4e1e-a86d-92c079e17dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:48.838088 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9cac3c05-a7bc-40bb-be3c-69f3fcc1dd85 tempest-ServersNegativeTestJSON-1752823681 None] Created volume successfully.
Sep 06 11:14:48.974766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:49.067849 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:49.118971 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:14:49.125557 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Deleted volume successfully.
Sep 06 11:14:49.231276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c2c3abdd-33f5-4045-9f5c-3c356ad4bed1 tempest-VolumesTestJSON-1367246480 None] Lock "cinder-30935d4c-75ad-4523-8d7b-f3af40c1d91e-delete_volume" released by "delete_volume" :: held 5.160s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:14:49.917301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Acquiring lock "cinder-91c4e502-8673-46bd-8d12-3595c5eaddf7-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:14:49.952866 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Lock "cinder-91c4e502-8673-46bd-8d12-3595c5eaddf7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:14:50.119243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:50.431432 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:14:50.432008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Volume volume-91c4e502-8673-46bd-8d12-3595c5eaddf7 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:14:50.604029 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] deleting rbd volume volume-91c4e502-8673-46bd-8d12-3595c5eaddf7 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:14:51.553520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:14:51.572553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Flow 'volume_create_manager' (bc3190a2-a465-4536-9cf7-4efc8abf0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:51.578865 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46f8fe8-b432-4f4d-9ff7-1b718ea09643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:51.594718 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46f8fe8-b432-4f4d-9ff7-1b718ea09643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-277101141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f20851ed-938d-4b09-8c29-9352d026a512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad114c7a41a47e785fd117e1103f168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:14:51Z,use_quota=True,user_id='3e904f27c02248389ae9ca86cb95c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:51.601227 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44c173c-b249-453c-a273-55bb831d92a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:51.604650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44c173c-b249-453c-a273-55bb831d92a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:51.609531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccdff19-5a0b-4b84-a581-8c187c63b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:51.613598 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccdff19-5a0b-4b84-a581-8c187c63b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20851ed-938d-4b09-8c29-9352d026a512', 'volume_name': 'volume-f20851ed-938d-4b09-8c29-9352d026a512', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:51.618284 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b6f75d-3af8-4c63-bbeb-7a3d8cdb4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:51.622224 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b6f75d-3af8-4c63-bbeb-7a3d8cdb4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:51.627183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3b614a-3d7f-4441-9790-33285df17602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:51.628297 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Volume f20851ed-938d-4b09-8c29-9352d026a512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20851ed-938d-4b09-8c29-9352d026a512', 'volume_size': 1}
Sep 06 11:14:51.628692 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] creating volume 'volume-f20851ed-938d-4b09-8c29-9352d026a512' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:14:51.629461 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:51.686200 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:14:51.697507 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:51.816076 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:51.864064 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:14:52.567781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:14:52.576578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:14:52.576578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3b614a-3d7f-4441-9790-33285df17602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20851ed-938d-4b09-8c29-9352d026a512', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:52.580391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5bbd24-c83f-4826-8a36-2873de84e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:14:52.672549 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Volume volume-f20851ed-938d-4b09-8c29-9352d026a512 (f20851ed-938d-4b09-8c29-9352d026a512): created successfully
Sep 06 11:14:52.677349 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5bbd24-c83f-4826-8a36-2873de84e886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:14:52.683793 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Flow 'volume_create_manager' (bc3190a2-a465-4536-9cf7-4efc8abf0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:14:52.786876 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a1597317-5714-406c-83c1-3c43fbcc8e0a tempest-ServersNegativeTestJSON-1752823681 None] Created volume successfully.
Sep 06 11:14:54.245908 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=63,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:14:54.408858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Created reservations ['6bbd2d1d-8fb4-4c77-aab7-d30f4717f8c2', 'b7975703-f0e6-4685-9d9e-7420a1073587', 'ba45527b-db24-4c3b-b764-961430c5aa5f', '4bd39243-3586-4965-8095-498f86e1849a'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:14:54.563975 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=54,cinder:DELETE=4,cinder:UPDATE=34,cinder:INSERT=8 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:14:54.719550 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:54.779614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:14:54.840022 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:14:54.859722 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Deleted volume successfully.
Sep 06 11:14:55.018630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a02f3fba-4b04-486a-9c26-266fdbf31dc3 tempest-VolumesTestJSON-1367246480 None] Lock "cinder-91c4e502-8673-46bd-8d12-3595c5eaddf7-delete_volume" released by "delete_volume" :: held 5.038s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:15:14.577080 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:15:34.578210 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:15:34.583816 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:15:51.690283 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:15:51.692717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:15:51.799147 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:15:51.887503 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:15:54.584665 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:16:14.578148 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:16:34.591894 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:16:34.592740 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:16:51.692843 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:16:51.694980 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:16:51.764815 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:16:51.809239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:16:54.937944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Acquiring lock "cinder-f20851ed-938d-4b09-8c29-9352d026a512-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:16:54.973081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Lock "cinder-f20851ed-938d-4b09-8c29-9352d026a512-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:16:55.328362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:16:55.748422 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:16:55.749362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Volume volume-f20851ed-938d-4b09-8c29-9352d026a512 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:16:56.239872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] deleting rbd volume volume-f20851ed-938d-4b09-8c29-9352d026a512 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:17:02.753898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Created reservations ['5d449b72-4d66-41b7-8f25-86ad1625376e', 'fb04baa6-1966-46f3-875a-dde0290d55cf', '3fcaab1f-8049-4061-bf11-3f54466b6828', 'ef9e1efa-701a-4428-b5f0-751f887c8b2b'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:17:03.071512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:03.151111 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:03.239767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:17:03.264807 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Deleted volume successfully.
Sep 06 11:17:03.428003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d69142c-40f9-486f-8a56-67730f530f88 tempest-ServersNegativeTestJSON-1752823681 None] Lock "cinder-f20851ed-938d-4b09-8c29-9352d026a512-delete_volume" released by "delete_volume" :: held 8.457s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:17:03.894396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Acquiring lock "cinder-20ad1fa0-c584-4591-bb6f-e9158e7f61ee-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:17:03.934045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Lock "cinder-20ad1fa0-c584-4591-bb6f-e9158e7f61ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:17:04.080487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:04.472993 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:17:04.473431 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Volume volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:17:04.662880 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] deleting rbd volume volume-20ad1fa0-c584-4591-bb6f-e9158e7f61ee {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:17:11.372440 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:17:11.373137 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:17:11.511763 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Created reservations ['4a4f5651-5796-4e8d-a39c-a90e68cbc883', '6d679fbb-6a05-499b-b7e9-12d0717fff3b', '96876a16-96ed-478a-9b92-9c507439e70d', 'ffb61d29-2cbc-4810-935b-8102d7bef34d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:17:11.788875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:11.861144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:12.053287 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:17:12.055542 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Deleted volume successfully.
Sep 06 11:17:12.165034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6624ab9b-0b7a-465b-8ef7-c384bd26286b tempest-ServersNegativeTestJSON-1752823681 None] Lock "cinder-20ad1fa0-c584-4591-bb6f-e9158e7f61ee-delete_volume" released by "delete_volume" :: held 8.236s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:17:24.112202 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:17:44.681540 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:17:51.696489 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:17:51.698034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:51.756198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:17:51.815265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:17:54.689440 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:18:24.665506 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:18:34.665959 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:18:51.693370 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:18:51.694025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:18:51.753695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:18:51.827447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:19:04.661363 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:19:12.929685 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:19:13.081873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:19:13.109268 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Flow 'volume_create_manager' (33ccd2c3-712b-46f4-9632-e768c56fbb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:13.116091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5853795d-4a96-4a0f-8cff-26f156897239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:13.135354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5853795d-4a96-4a0f-8cff-26f156897239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1469189862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a65b0ac0-1d9b-4861-a8d7-894c6b3e5846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b360e0ffe64c3bb5897486a18eda10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:19:13Z,use_quota=True,user_id='226a6d965ff14deebdead8370fc00d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:13.141332 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18640075-e1d1-4414-b27b-ad98881f70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:13.145931 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18640075-e1d1-4414-b27b-ad98881f70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:13.152182 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9f781c-170a-491f-9c37-193a86ce2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:13.159579 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9f781c-170a-491f-9c37-193a86ce2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'volume_name': 'volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:13.166175 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab5162c-f61c-414f-ac5a-cb9b253d1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:13.170551 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab5162c-f61c-414f-ac5a-cb9b253d1b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:13.177280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a133872-9f69-4307-a3c0-b9cd719b4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:13.182706 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume a65b0ac0-1d9b-4861-a8d7-894c6b3e5846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'volume_size': 1}
Sep 06 11:19:13.182706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] creating volume 'volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:19:13.182706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:19:14.162201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:19:14.165481 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:19:14.173525 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a133872-9f69-4307-a3c0-b9cd719b4a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:14.179128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab98185-8977-4d0e-ab42-c097152f90b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:14.294200 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846 (a65b0ac0-1d9b-4861-a8d7-894c6b3e5846): created successfully
Sep 06 11:19:14.305498 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab98185-8977-4d0e-ab42-c097152f90b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:14.309677 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Flow 'volume_create_manager' (33ccd2c3-712b-46f4-9632-e768c56fbb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:14.399480 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9a0370f2-10b0-4b1a-92d3-ed45f895ee17 tempest-AttachVolumeShelveTestJSON-1383535698 None] Created volume successfully.
Sep 06 11:19:24.665001 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:19:40.026072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:19:40.084208 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (afa15040-121b-4d5f-bb2a-5a758071bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:40.091695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba6962a-0e22-4097-8f3f-57454ec2314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:40.120342 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba6962a-0e22-4097-8f3f-57454ec2314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1997837997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=966c89e9-c0df-4b34-b528-6921428e5112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349b59222491484fb4e225ccff7d4b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:19:40Z,use_quota=True,user_id='d25507cda3a84eff852a5d17e09eae6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:40.144276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1badfbd8-192a-46cc-8c0c-f8641c279b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:40.167126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1badfbd8-192a-46cc-8c0c-f8641c279b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:40.178889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30537cf0-8592-4672-995d-d29f938af5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:40.184073 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30537cf0-8592-4672-995d-d29f938af5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966c89e9-c0df-4b34-b528-6921428e5112', 'volume_name': 'volume-966c89e9-c0df-4b34-b528-6921428e5112', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:40.189876 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af1fd2e-8830-4bf0-94d9-574e0bcd4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:40.194065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af1fd2e-8830-4bf0-94d9-574e0bcd4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:40.199801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54e3f94-5d4f-4715-929d-db9bbdb0b067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:40.201325 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Volume 966c89e9-c0df-4b34-b528-6921428e5112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966c89e9-c0df-4b34-b528-6921428e5112', 'volume_size': 1}
Sep 06 11:19:40.201892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] creating volume 'volume-966c89e9-c0df-4b34-b528-6921428e5112' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:19:40.202724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:19:41.106059 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:19:41.106740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:19:41.111066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54e3f94-5d4f-4715-929d-db9bbdb0b067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966c89e9-c0df-4b34-b528-6921428e5112', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:41.117165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed5193-2e13-4cfe-ba3c-f2088f3a5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:41.242476 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-966c89e9-c0df-4b34-b528-6921428e5112 (966c89e9-c0df-4b34-b528-6921428e5112): created successfully
Sep 06 11:19:41.247424 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed5193-2e13-4cfe-ba3c-f2088f3a5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:41.261183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (afa15040-121b-4d5f-bb2a-5a758071bddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:41.364967 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-df65aeca-86fd-4108-90cb-f8954f28f03a tempest-VolumesBackupsAdminTest-1032927654 None] Created volume successfully.
Sep 06 11:19:43.099139 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:19:42Z,data_timestamp=2022-09-06T11:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1868233464',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ad9bbeb6-4261-492e-8207-a77ed97d97a2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='349b59222491484fb4e225ccff7d4b62',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d25507cda3a84eff852a5d17e09eae6d',volume_id=966c89e9-c0df-4b34-b528-6921428e5112)
Sep 06 11:19:43.099943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] continue_backup in rpcapi backup_id ad9bbeb6-4261-492e-8207-a77ed97d97a2 {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:19:43.293203 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:19:44.161637 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.868s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:19:44.163083 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-966c89e9-c0df-4b34-b528-6921428e5112', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '966c89e9-c0df-4b34-b528-6921428e5112', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:19:44.179905 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] Initialize volume connection completed successfully.
Sep 06 11:19:44.672663 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:19:51.634537 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] Terminate volume connection completed successfully.
Sep 06 11:19:51.656582 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b8f61e54-8acd-4660-87a2-4e6d169519e9 tempest-VolumesBackupsAdminTest-1032927654 None] Remove volume export completed successfully.
Sep 06 11:19:51.693904 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:19:51.695260 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:19:51.749262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:19:51.796093 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:19:52.549373 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-659d4668-bf08-4079-af6c-29e1252aa8fa req-a96acb54-edd2-4c39-8fa4-215325ecde74 tempest-AttachVolumeShelveTestJSON-1383535698 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:19:53.342501 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-659d4668-bf08-4079-af6c-29e1252aa8fa req-a96acb54-edd2-4c39-8fa4-215325ecde74 tempest-AttachVolumeShelveTestJSON-1383535698 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.792s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:19:53.343380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-659d4668-bf08-4079-af6c-29e1252aa8fa req-a96acb54-edd2-4c39-8fa4-215325ecde74 tempest-AttachVolumeShelveTestJSON-1383535698 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:19:53.510087 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-659d4668-bf08-4079-af6c-29e1252aa8fa req-a96acb54-edd2-4c39-8fa4-215325ecde74 tempest-AttachVolumeShelveTestJSON-1383535698 None] Connection info returned from driver {'name': 'volumes/volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a65b0ac0-1d9b-4861-a8d7-894c6b3e5846', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e39631df-c244-4213-9fed-cf50e585949b'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:19:53.677994 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-659d4668-bf08-4079-af6c-29e1252aa8fa req-a96acb54-edd2-4c39-8fa4-215325ecde74 tempest-AttachVolumeShelveTestJSON-1383535698 None] attachment_update completed successfully.
Sep 06 11:19:55.293170 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=26,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:19:55.412340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:19:55.435616 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (fe359096-8d5d-4f2f-93c8-d9be236458ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:55.442688 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37452f7e-2910-4a21-92b6-213430c70812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:55.467855 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37452f7e-2910-4a21-92b6-213430c70812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:19:55Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ad9bbeb6-4261-492e-8207-a77ed97d97a2',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=46f675bf-078c-4915-9fac-b26c2c3c5991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349b59222491484fb4e225ccff7d4b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:19:55Z,use_quota=True,user_id='d25507cda3a84eff852a5d17e09eae6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:55.475386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4d115-befc-4ef3-b722-0a9fb12c66f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:55.480437 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4d115-befc-4ef3-b722-0a9fb12c66f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:55.485893 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76b4675-6943-4625-a745-546df07d1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:55.510180 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76b4675-6943-4625-a745-546df07d1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f675bf-078c-4915-9fac-b26c2c3c5991', 'volume_name': 'volume-46f675bf-078c-4915-9fac-b26c2c3c5991', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:55.523412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63083cf6-5c99-4b35-a978-1d992b25a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:55.530594 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63083cf6-5c99-4b35-a978-1d992b25a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:55.540109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7616910b-d2d0-4888-a1fc-ff2913bc686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:55.541891 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Volume 46f675bf-078c-4915-9fac-b26c2c3c5991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f675bf-078c-4915-9fac-b26c2c3c5991', 'volume_size': 1}
Sep 06 11:19:55.541891 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] creating volume 'volume-46f675bf-078c-4915-9fac-b26c2c3c5991' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:19:55.542925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:19:56.620463 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:19:56.621402 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:19:56.625004 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7616910b-d2d0-4888-a1fc-ff2913bc686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f675bf-078c-4915-9fac-b26c2c3c5991', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:56.630303 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e97e5b-7925-4f80-b71b-03fdc1a3e5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:19:56.713612 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-46f675bf-078c-4915-9fac-b26c2c3c5991 (46f675bf-078c-4915-9fac-b26c2c3c5991): created successfully
Sep 06 11:19:56.721824 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e97e5b-7925-4f80-b71b-03fdc1a3e5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:19:56.734386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (fe359096-8d5d-4f2f-93c8-d9be236458ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:19:56.876522 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Created volume successfully.
Sep 06 11:19:57.451499 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:19:58.599065 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.147s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:19:58.602441 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46f675bf-078c-4915-9fac-b26c2c3c5991', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '46f675bf-078c-4915-9fac-b26c2c3c5991', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:19:58.628631 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Initialize volume connection completed successfully.
Sep 06 11:20:04.511171 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Terminate volume connection completed successfully.
Sep 06 11:20:04.546136 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e0d89952-200c-42ac-ab19-c412b156d008 tempest-VolumesBackupsAdminTest-1032927654 None] Remove volume export completed successfully.
Sep 06 11:20:06.219029 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Acquiring lock "cinder-46f675bf-078c-4915-9fac-b26c2c3c5991-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:20:06.239732 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-46f675bf-078c-4915-9fac-b26c2c3c5991-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:20:06.382089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:09.620297 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-46f675bf-078c-4915-9fac-b26c2c3c5991 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:20:10.003486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] deleting rbd volume volume-46f675bf-078c-4915-9fac-b26c2c3c5991 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:20:14.709891 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3a8fe7a2-db7b-48ff-9566-ada4b16be05f tempest-GroupSnapshotsV319Test-814800700 None] Group tempest-GroupSnapshotsV319Test-Group-1138478607: creating
Sep 06 11:20:14.836594 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3a8fe7a2-db7b-48ff-9566-ada4b16be05f tempest-GroupSnapshotsV319Test-814800700 None] Group tempest-GroupSnapshotsV319Test-Group-1138478607: created successfully
Sep 06 11:20:14.847688 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3a8fe7a2-db7b-48ff-9566-ada4b16be05f tempest-GroupSnapshotsV319Test-814800700 None] Create group completed successfully.
Sep 06 11:20:16.168355 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=37,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:20:16.421412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Created reservations ['71b18678-85f4-460e-88cb-07d9d7c7fbb7', '053786c8-03f2-4157-9e9f-bf6877bbaa24', '23f5ea59-2d59-4d67-9f50-5f8db77fa600', 'bd529e0b-08ff-4781-85ac-0833def3bc73'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:20:16.766143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:16.800367 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:16.830579 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:20:16.842365 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Deleted volume successfully.
Sep 06 11:20:16.924483 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-497cae4c-8bd7-4b4e-845d-0792e86e1d52 tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-46f675bf-078c-4915-9fac-b26c2c3c5991-delete_volume" released by "delete_volume" :: held 10.683s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:20:16.950151 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:20:16.971196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Flow 'volume_create_manager' (e4bb8a97-b790-461d-9243-68f3af705b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:20:16.977608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33421824-f8d8-4ad8-a1dd-af8d8ab5dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:16.995096 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33421824-f8d8-4ad8-a1dd-af8d8ab5dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-483097764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d08c822d-9871-4dca-b18e-37bac984897d,host='ncdv-master-1@ceph#ceph',id=99001977-4b9c-4f15-a2f4-f1ef52ae653f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ce1e90c3b34ad680374931c418d3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:20:17Z,use_quota=True,user_id='c06b52e0ef05414eb777eac277d8e800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5861174-fc6e-4090-b72a-42ad5f9fd7ad),volume_type_id=d5861174-fc6e-4090-b72a-42ad5f9fd7ad)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:17.000421 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d412f0-bb1e-4977-bef0-106fa9bcec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:17.006474 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d412f0-bb1e-4977-bef0-106fa9bcec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:17.011849 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a759181-db8f-463a-89bf-1a9b0c318dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:17.015883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a759181-db8f-463a-89bf-1a9b0c318dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99001977-4b9c-4f15-a2f4-f1ef52ae653f', 'volume_name': 'volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:17.020714 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4b3a5-21bd-4cfb-b5e0-322e72a3f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:17.024661 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb4b3a5-21bd-4cfb-b5e0-322e72a3f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:17.032021 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb90f79-62b7-4b5d-9c64-9b7cb01f4249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:17.033132 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Volume 99001977-4b9c-4f15-a2f4-f1ef52ae653f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f', 'volume_size': 1}
Sep 06 11:20:17.033537 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] creating volume 'volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:20:17.034348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:17.852051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:20:17.853920 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:20:17.864486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb90f79-62b7-4b5d-9c64-9b7cb01f4249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:17.885930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d4443-5fcd-4987-9373-d98a7f89849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:18.015752 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Volume volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f (99001977-4b9c-4f15-a2f4-f1ef52ae653f): created successfully
Sep 06 11:20:18.020337 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434d4443-5fcd-4987-9373-d98a7f89849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:18.025823 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Flow 'volume_create_manager' (e4bb8a97-b790-461d-9243-68f3af705b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:20:18.101268 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c51b499e-91a1-404b-acc0-a4400ec95509 tempest-GroupSnapshotsV319Test-814800700 None] Created volume successfully.
Sep 06 11:20:19.515625 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cfd41fa7-30b4-438b-84d5-6f7e096e9fd4 tempest-GroupSnapshotsV319Test-814800700 None] GroupSnapshot 597d6150-db85-403d-8318-f643fde12f6b: creating.
Sep 06 11:20:19.592767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-cfd41fa7-30b4-438b-84d5-6f7e096e9fd4 tempest-GroupSnapshotsV319Test-814800700 None] Group snapshot 597d6150-db85-403d-8318-f643fde12f6b: creating. {{(pid=133823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Sep 06 11:20:19.628015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cfd41fa7-30b4-438b-84d5-6f7e096e9fd4 tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:20.308254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:20:20.330905 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (866700c9-53d2-418d-accb-a8e97da9366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:20:20.340031 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf185b-85ab-4370-85d0-65f297c2162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:20.354612 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf185b-85ab-4370-85d0-65f297c2162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1596773981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdf0fcd3-0459-4b36-a65d-9923f193f556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349b59222491484fb4e225ccff7d4b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:20:20Z,use_quota=True,user_id='d25507cda3a84eff852a5d17e09eae6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:20.359941 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bac017-2091-4e37-9fca-883caaa80547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:20.364942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bac017-2091-4e37-9fca-883caaa80547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:20.370079 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a75f84-ace2-4c9d-ae98-d4b2411f645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:20.374595 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a75f84-ace2-4c9d-ae98-d4b2411f645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf0fcd3-0459-4b36-a65d-9923f193f556', 'volume_name': 'volume-fdf0fcd3-0459-4b36-a65d-9923f193f556', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:20.379515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea8366-fec0-47bb-aea5-808c125c54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:20.384386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea8366-fec0-47bb-aea5-808c125c54bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:20.389130 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d6ae9-b1cb-42bd-b99d-129287268082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:20.390214 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Volume fdf0fcd3-0459-4b36-a65d-9923f193f556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf0fcd3-0459-4b36-a65d-9923f193f556', 'volume_size': 1}
Sep 06 11:20:20.390604 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] creating volume 'volume-fdf0fcd3-0459-4b36-a65d-9923f193f556' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:20:20.391386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:20.881357 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:20:20.882063 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:20:20.885719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d6ae9-b1cb-42bd-b99d-129287268082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf0fcd3-0459-4b36-a65d-9923f193f556', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:20.894484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf07d5a0-342a-47ed-bf69-d776aa8a5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:20:21.038833 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-fdf0fcd3-0459-4b36-a65d-9923f193f556 (fdf0fcd3-0459-4b36-a65d-9923f193f556): created successfully
Sep 06 11:20:21.044072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf07d5a0-342a-47ed-bf69-d776aa8a5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:20:21.050043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Flow 'volume_create_manager' (866700c9-53d2-418d-accb-a8e97da9366b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:20:21.118107 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-18ff449f-1fcd-4bad-a4a8-b1e447f804ac tempest-VolumesBackupsAdminTest-1032927654 None] Created volume successfully.
Sep 06 11:20:22.815419 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cfd41fa7-30b4-438b-84d5-6f7e096e9fd4 tempest-GroupSnapshotsV319Test-814800700 None] group_snapshot 597d6150-db85-403d-8318-f643fde12f6b: created successfully
Sep 06 11:20:22.914437 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:20:22Z,data_timestamp=2022-09-06T11:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1065945924',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=fde68fa3-d25c-484b-a8b0-b2db4d11feec,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='349b59222491484fb4e225ccff7d4b62',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d25507cda3a84eff852a5d17e09eae6d',volume_id=fdf0fcd3-0459-4b36-a65d-9923f193f556)
Sep 06 11:20:22.915232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] continue_backup in rpcapi backup_id fde68fa3-d25c-484b-a8b0-b2db4d11feec {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:20:23.065792 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:20:23.964018 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.898s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:20:23.965100 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fdf0fcd3-0459-4b36-a65d-9923f193f556', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'fdf0fcd3-0459-4b36-a65d-9923f193f556', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:20:23.982743 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] Initialize volume connection completed successfully.
Sep 06 11:20:24.737490 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] group_snapshot 597d6150-db85-403d-8318-f643fde12f6b: deleting
Sep 06 11:20:24.757225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] group_snapshot 597d6150-db85-403d-8318-f643fde12f6b: deleting {{(pid=133823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Sep 06 11:20:24.776317 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:28.240122 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:20:28.395258 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-68934543 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-68934543, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:20:28.396055 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-68934543 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-68934543, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:20:28.496155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] Created reservations ['84b57a0f-77cc-45ad-9f7a-3bb03b4a5be7', 'e1000060-238f-40b0-9247-8c808c80bab7', '26415287-8ccf-46e4-827e-00ae543655f0', '728ad53a-6990-4cfe-87d4-0318316ad990'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:20:28.730176 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2a61ccfb-e8e8-40c6-8efe-987a73370a71 tempest-GroupSnapshotsV319Test-814800700 None] group_snapshot 597d6150-db85-403d-8318-f643fde12f6b: deleted successfully
Sep 06 11:20:29.501685 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:29.655332 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:20:29.655792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Volume volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:20:29.781906 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] deleting rbd volume volume-99001977-4b9c-4f15-a2f4-f1ef52ae653f {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:20:30.535606 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] Terminate volume connection completed successfully.
Sep 06 11:20:30.552859 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7f3d1999-45cc-4b9e-8a40-dd89d90d4477 tempest-VolumesBackupsAdminTest-1032927654 None] Remove volume export completed successfully.
Sep 06 11:20:34.924774 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Created reservations ['a229c868-2865-4c1d-94c1-ca9409a00c77'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:20:34.951923 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-68934543 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-68934543, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:20:35.043527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Created reservations ['86259b4c-4c1f-4336-b941-ab9332e31be3', 'd46b2ef1-5797-4b66-ac88-850b6f56d052', 'e1e781fe-ace5-4857-8416-7ff5495770b8', '35b8dc69-cfcd-4d5a-a6dc-4e1c0e938f43'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:20:35.449027 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=68,cinder:DELETE=1,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:20:35.558790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:35.602695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:35.633552 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:20:35.640214 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-df770849-b204-4a95-ac30-2ac8fad3935c tempest-GroupSnapshotsV319Test-814800700 None] Delete group completed successfully.
Sep 06 11:20:40.727264 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Acquiring lock "cinder-fdf0fcd3-0459-4b36-a65d-9923f193f556-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:20:40.736574 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-fdf0fcd3-0459-4b36-a65d-9923f193f556-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:20:40.858120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:43.499746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-fdf0fcd3-0459-4b36-a65d-9923f193f556 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:20:44.252656 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] deleting rbd volume volume-fdf0fcd3-0459-4b36-a65d-9923f193f556 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:20:49.759637 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Created reservations ['b72cd8de-0f36-48cc-b3de-4347eed8d039', '1deb3781-696a-413b-a53e-7bbbb57549db', 'f908fa59-a9fe-4930-b1ab-4c95f1c5af73', 'f66dbbf8-1cd9-4d7b-8796-fe3fd072127d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:20:50.062717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:50.099644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:50.149597 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:20:50.161657 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Deleted volume successfully.
Sep 06 11:20:50.256959 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e46cfea0-bb39-4106-930c-b6ce998860a7 tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-fdf0fcd3-0459-4b36-a65d-9923f193f556-delete_volume" released by "delete_volume" :: held 9.520s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:20:50.413625 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-e915af4e-205c-46bb-afa9-f797bbcbacec req-8800844b-b110-4c27-9c35-0ff4e654e77d tempest-AttachVolumeShelveTestJSON-1383535698 None] Terminate volume connection completed successfully.
Sep 06 11:20:50.414334 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-e915af4e-205c-46bb-afa9-f797bbcbacec req-8800844b-b110-4c27-9c35-0ff4e654e77d tempest-AttachVolumeShelveTestJSON-1383535698 None] Deleting attachment e39631df-c244-4213-9fed-cf50e585949b. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:20:50.535075 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Acquiring lock "cinder-966c89e9-c0df-4b34-b528-6921428e5112-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:20:50.548619 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-966c89e9-c0df-4b34-b528-6921428e5112-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:20:50.676776 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:53.435432 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Volume volume-966c89e9-c0df-4b34-b528-6921428e5112 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:20:54.097467 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] deleting rbd volume volume-966c89e9-c0df-4b34-b528-6921428e5112 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:20:54.100490 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:20:54.101324 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:54.196344 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:20:54.246567 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:00.284660 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=41,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:00.398789 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Created reservations ['e51cf3bd-a0f3-4d56-ab38-2552080aec3e', '9223a103-2d6c-41e5-ba34-85859cb16dfd', '7be5c6b7-f196-4f14-8b11-18cefee1b260', '46d314ec-d9ce-4779-8af3-cef0d8a81448'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:00.645494 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:00.674264 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:00.700776 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:00.705020 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Deleted volume successfully.
Sep 06 11:21:00.797532 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-be77cd24-70c1-4dc7-bb94-a0088eeff22e tempest-VolumesBackupsAdminTest-1032927654 None] Lock "cinder-966c89e9-c0df-4b34-b528-6921428e5112-delete_volume" released by "delete_volume" :: held 10.249s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:07.368739 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:07.400788 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (ce64e80b-dca3-4eb3-b54e-c1c376478d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:07.407233 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f86929-f4ae-4aa1-b307-390a7c2946b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:07.410435 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=36,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:07.424882 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f86929-f4ae-4aa1-b307-390a7c2946b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-136848123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=45f2350f-dd93-42b0-a5c2-481a4358a6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995f136d06074af89facc72f6a4f04df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:07Z,use_quota=True,user_id='1e9a7fe0713e4433a5c7c9487a1699fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:07.430091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db637728-0f7d-406c-86d7-f95629b0bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:07.434867 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db637728-0f7d-406c-86d7-f95629b0bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:07.439636 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3773af-0f50-438e-a3fa-93c99a7821fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:07.575497 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3773af-0f50-438e-a3fa-93c99a7821fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'volume_name': 'volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70374670>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:07.580522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dc26c2-ad9d-465f-8f89-cb98c61da887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:07.585278 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dc26c2-ad9d-465f-8f89-cb98c61da887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:07.599089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d1f37c-5e0e-4605-bc38-2a09fe1c89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:07.599089 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Volume 45f2350f-dd93-42b0-a5c2-481a4358a6c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70374670>}
Sep 06 11:21:07.599428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Cloning 45f2350f-dd93-42b0-a5c2-481a4358a6c3 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:21:07.599428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:07.608380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:07.680900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 21, 7, 612165)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:21:07.681682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:21:07.682419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:21:07.716596 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.108s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:07.719402 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:21:07.747167 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 21, 7, 727221)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:21:07.747888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:21:07.748484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:21:07.773423 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:08.036205 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] creating snapshot='volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:21:10.206716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3.clone_snap' to 'volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:21:10.331970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:10.351783 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (4a0ddb77-f3b3-4f5c-bf31-b0e07e76ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:10.363081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273f2b58-84c4-439b-a3f5-286cb1c5bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:10.385172 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273f2b58-84c4-439b-a3f5-286cb1c5bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-117815474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0bd148b-3427-46d6-a8a7-4898a8bb255e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:08Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:10.391985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f9f4b-666f-4bd9-91ff-165314a13ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:10.402942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f9f4b-666f-4bd9-91ff-165314a13ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:10.409767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df27757-8aa8-4305-9111-7478ae948249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:10.414748 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df27757-8aa8-4305-9111-7478ae948249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0bd148b-3427-46d6-a8a7-4898a8bb255e', 'volume_name': 'volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:10.420051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62150e8-c71f-47b0-9e63-d1c4af4b3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:10.424668 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62150e8-c71f-47b0-9e63-d1c4af4b3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:10.429688 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e8f6af-b735-4d86-b66e-279aa36b861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:10.430951 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Volume b0bd148b-3427-46d6-a8a7-4898a8bb255e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e', 'volume_size': 1}
Sep 06 11:21:10.431524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:10.432641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:11.134810 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:11.135443 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:11.140085 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e8f6af-b735-4d86-b66e-279aa36b861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:11.144735 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d431c08f-3e87-4048-a7b8-c7f41ed20051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:11.206590 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Volume volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e (b0bd148b-3427-46d6-a8a7-4898a8bb255e): created successfully
Sep 06 11:21:11.213051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d431c08f-3e87-4048-a7b8-c7f41ed20051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:11.231493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (4a0ddb77-f3b3-4f5c-bf31-b0e07e76ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:11.325847 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-17af3afc-5354-4fa4-bef4-325efc9e8052 tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:21:11.811576 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:11.814720 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:11.816014 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:12.207354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:21:12.208792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Marking volume 45f2350f-dd93-42b0-a5c2-481a4358a6c3 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:21:12.276277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 45f2350f-dd93-42b0-a5c2-481a4358a6c3. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:21:12.276277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Creating volume glance metadata for volume 45f2350f-dd93-42b0-a5c2-481a4358a6c3 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:21:12.350073 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e9c15519-60c3-4e8b-ac04-4c067b17a5c8 tempest-VolumesActionsTest-1756987803 None] Acquiring lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e" by "attach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:12.359697 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e9c15519-60c3-4e8b-ac04-4c067b17a5c8 tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e" acquired by "attach_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:12.500370 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d1f37c-5e0e-4605-bc38-2a09fe1c89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70374670>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:12.505012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae4bae9-94a7-482e-8ef6-edf5a1f750fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:12.638198 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Volume volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3 (45f2350f-dd93-42b0-a5c2-481a4358a6c3): created successfully
Sep 06 11:21:12.639830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae4bae9-94a7-482e-8ef6-edf5a1f750fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:12.646665 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (ce64e80b-dca3-4eb3-b54e-c1c376478d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:12.656779 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e9c15519-60c3-4e8b-ac04-4c067b17a5c8 tempest-VolumesActionsTest-1756987803 None] Attaching volume b0bd148b-3427-46d6-a8a7-4898a8bb255e to instance edb1ab51-5c16-42a8-b04f-b3b203315f77 at mountpoint /dev/sdb on host None.
Sep 06 11:21:12.738421 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-357d0cbc-b40f-45b5-9a7c-295b7364eebc tempest-VolumesCloneTest-1174177062 None] Created volume successfully.
Sep 06 11:21:12.749063 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e9c15519-60c3-4e8b-ac04-4c067b17a5c8 tempest-VolumesActionsTest-1756987803 None] Attach volume completed successfully.
Sep 06 11:21:12.757717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e9c15519-60c3-4e8b-ac04-4c067b17a5c8 tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e" released by "attach_volume" :: held 0.398s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:13.497957 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Terminate volume connection completed successfully.
Sep 06 11:21:13.531235 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Acquiring lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" by "detach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:13.544136 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:13.558649 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Detaching volume b0bd148b-3427-46d6-a8a7-4898a8bb255e from instance edb1ab51-5c16-42a8-b04f-b3b203315f77.
Sep 06 11:21:13.839728 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Detach volume completed successfully.
Sep 06 11:21:13.844509 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a06aec29-ebef-4129-8dde-b8921ace6061 tempest-VolumesActionsTest-63616406 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" released by "detach_volume" :: held 0.301s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:14.060412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3ddb75c5-20ba-401f-ab68-ba9fb636df9c tempest-VolumesActionsTest-1756987803 None] Acquiring lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" by "detach_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:14.072225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3ddb75c5-20ba-401f-ab68-ba9fb636df9c tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:14.072647 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3ddb75c5-20ba-401f-ab68-ba9fb636df9c tempest-VolumesActionsTest-1756987803 None] Volume detach called, but volume not attached.
Sep 06 11:21:14.083734 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3ddb75c5-20ba-401f-ab68-ba9fb636df9c tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:14.600435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:14.651686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (47fa679e-5034-42bc-9880-b4faa4378a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:14.663424 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a22c10-6b2d-4103-b956-1fbebe6ed688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:14.691034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a22c10-6b2d-4103-b956-1fbebe6ed688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-197794778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab2d995c-9997-4e51-9cd3-4a11897aa411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995f136d06074af89facc72f6a4f04df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=45f2350f-dd93-42b0-a5c2-481a4358a6c3,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:14Z,use_quota=True,user_id='1e9a7fe0713e4433a5c7c9487a1699fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:14.699663 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8cbb12-7e62-4f36-b545-07228d8265ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:14.705116 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8cbb12-7e62-4f36-b545-07228d8265ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:14.711268 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a8e7ea-25ae-4eca-90fd-98417a11be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:14.730278 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a8e7ea-25ae-4eca-90fd-98417a11be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ab2d995c-9997-4e51-9cd3-4a11897aa411', 'volume_name': 'volume-ab2d995c-9997-4e51-9cd3-4a11897aa411', 'volume_size': 1, 'source_volid': '45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:14.735163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5f8c21-f948-44c7-8cb5-dde821445cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:14.739219 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5f8c21-f948-44c7-8cb5-dde821445cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:14.743894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a3e9ef-e10f-4e2e-bc98-c6bc38e2faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:14.745351 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Volume ab2d995c-9997-4e51-9cd3-4a11897aa411: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ab2d995c-9997-4e51-9cd3-4a11897aa411', 'volume_size': 1, 'source_volid': '45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'source_volstatus': 'available'}
Sep 06 11:21:14.758147 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:14.977071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] creating snapshot='volume-ab2d995c-9997-4e51-9cd3-4a11897aa411.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:21:17.588874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] cloning 'volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3@volume-ab2d995c-9997-4e51-9cd3-4a11897aa411.clone_snap' to 'volume-ab2d995c-9997-4e51-9cd3-4a11897aa411' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:21:19.477068 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:19.479282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:19.479745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:20.123555 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:21:20.124593 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Marking volume ab2d995c-9997-4e51-9cd3-4a11897aa411 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:21:20.228510 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Copying metadata from source volume 45f2350f-dd93-42b0-a5c2-481a4358a6c3 to ab2d995c-9997-4e51-9cd3-4a11897aa411. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Sep 06 11:21:20.437027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a3e9ef-e10f-4e2e-bc98-c6bc38e2faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2d995c-9997-4e51-9cd3-4a11897aa411', 'volume_size': 1, 'source_volid': '45f2350f-dd93-42b0-a5c2-481a4358a6c3', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.441991 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d2c817-e021-4f96-8a01-457953581429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.628361 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Volume volume-ab2d995c-9997-4e51-9cd3-4a11897aa411 (ab2d995c-9997-4e51-9cd3-4a11897aa411): created successfully
Sep 06 11:21:20.634002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d2c817-e021-4f96-8a01-457953581429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.640508 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (47fa679e-5034-42bc-9880-b4faa4378a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:20.863182 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e279a364-f979-4521-b9af-fe8664bc7832 tempest-VolumesCloneTest-1174177062 None] Created volume successfully.
Sep 06 11:21:20.901867 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:20.921654 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (7b718c6f-3f2b-420d-972e-4f5b97687a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:20.929367 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0f95d-38aa-4ba8-bf5c-8718a3c3f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.946941 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b0f95d-38aa-4ba8-bf5c-8718a3c3f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035173198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=58b6e681-6126-487d-9875-8fc18eaacc81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:20Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.953136 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f75c06e-bb71-43eb-bbe2-d2d7d21db2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.960136 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f75c06e-bb71-43eb-bbe2-d2d7d21db2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.965805 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6ef349-3b84-487a-af45-7cc12cadf21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.970531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6ef349-3b84-487a-af45-7cc12cadf21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b6e681-6126-487d-9875-8fc18eaacc81', 'volume_name': 'volume-58b6e681-6126-487d-9875-8fc18eaacc81', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.975875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a96c4a-de65-44a1-b211-f6bb5dee8aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.980288 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a96c4a-de65-44a1-b211-f6bb5dee8aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:20.987330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5c28da-eb06-4424-95be-99522a47936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:20.993641 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Volume 58b6e681-6126-487d-9875-8fc18eaacc81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b6e681-6126-487d-9875-8fc18eaacc81', 'volume_size': 1}
Sep 06 11:21:20.993641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-58b6e681-6126-487d-9875-8fc18eaacc81' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:20.993641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:21.904662 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:21.932307 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (8c612fff-7921-4e86-ad65-205159e3c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:21.944137 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315c38ea-1acc-4592-ac55-c40965a783ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:21.972130 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315c38ea-1acc-4592-ac55-c40965a783ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1539751534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bfd6840d-9a50-4476-9a21-94296363acb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995f136d06074af89facc72f6a4f04df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:22Z,use_quota=True,user_id='1e9a7fe0713e4433a5c7c9487a1699fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:21.978745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c0b23b-54c9-45d0-88af-3f9e128ff1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:21.983679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c0b23b-54c9-45d0-88af-3f9e128ff1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:21.989044 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fdd770-6337-489d-98e3-f0b79fb961af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:21.994350 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fdd770-6337-489d-98e3-f0b79fb961af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd6840d-9a50-4476-9a21-94296363acb2', 'volume_name': 'volume-bfd6840d-9a50-4476-9a21-94296363acb2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.003280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc7827-0f02-4674-9710-4fbb1d61ef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:22.008829 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc7827-0f02-4674-9710-4fbb1d61ef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.014065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38c8a3-dc72-47f7-a806-880e43eb69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:22.015263 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Volume bfd6840d-9a50-4476-9a21-94296363acb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd6840d-9a50-4476-9a21-94296363acb2', 'volume_size': 1}
Sep 06 11:21:22.015864 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] creating volume 'volume-bfd6840d-9a50-4476-9a21-94296363acb2' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:22.016856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:22.101481 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:22.102466 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:22.107567 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5c28da-eb06-4424-95be-99522a47936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b6e681-6126-487d-9875-8fc18eaacc81', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.112751 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd409391-9f43-4db7-9a60-0613062ec9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:22.228164 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Volume volume-58b6e681-6126-487d-9875-8fc18eaacc81 (58b6e681-6126-487d-9875-8fc18eaacc81): created successfully
Sep 06 11:21:22.232083 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd409391-9f43-4db7-9a60-0613062ec9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.237916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (7b718c6f-3f2b-420d-972e-4f5b97687a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:22.314408 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b404ccc0-f4ed-4f64-a71b-8b561940b5da tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:21:22.686260 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:22.686693 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:22.693643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38c8a3-dc72-47f7-a806-880e43eb69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd6840d-9a50-4476-9a21-94296363acb2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.697939 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a4a702-f056-48ab-842c-b000d2643629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:22.817109 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Volume volume-bfd6840d-9a50-4476-9a21-94296363acb2 (bfd6840d-9a50-4476-9a21-94296363acb2): created successfully
Sep 06 11:21:22.820767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a4a702-f056-48ab-842c-b000d2643629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:22.826241 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (8c612fff-7921-4e86-ad65-205159e3c356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:22.914250 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ebdfe705-4155-462c-a814-fcabd8082e7c tempest-VolumesCloneTest-1174177062 None] Created volume successfully.
Sep 06 11:21:22.951653 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Acquiring lock "cinder-58b6e681-6126-487d-9875-8fc18eaacc81-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:22.960033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Lock "cinder-58b6e681-6126-487d-9875-8fc18eaacc81-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:23.069236 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:23.241112 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:23.241764 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Volume volume-58b6e681-6126-487d-9875-8fc18eaacc81 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:23.589151 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] deleting rbd volume volume-58b6e681-6126-487d-9875-8fc18eaacc81 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:24.660659 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=70,cinder:UPDATE=15,cinder:INSERT=14,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:24.768299 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:24.798192 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (7f5dbd1b-0de4-482c-a1c5-2e71619a234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:24.805848 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c754dba9-2db6-4daa-9d1b-6684e0281141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:24.833255 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c754dba9-2db6-4daa-9d1b-6684e0281141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-933846715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fb32205e-322e-49fc-bec3-4ef4bbc4fcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995f136d06074af89facc72f6a4f04df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=bfd6840d-9a50-4476-9a21-94296363acb2,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:25Z,use_quota=True,user_id='1e9a7fe0713e4433a5c7c9487a1699fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:24.838573 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70708d89-df2f-4369-9213-01ebbcf41a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:24.842558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70708d89-df2f-4369-9213-01ebbcf41a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:24.847705 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15d7f5-c737-483e-b021-d4c5d7c866af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:24.867400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15d7f5-c737-483e-b021-d4c5d7c866af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb32205e-322e-49fc-bec3-4ef4bbc4fcab', 'volume_name': 'volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab', 'volume_size': 2, 'source_volid': 'bfd6840d-9a50-4476-9a21-94296363acb2', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:24.872578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f8268d-2c04-4da9-a880-df419f5391b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:24.880317 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f8268d-2c04-4da9-a880-df419f5391b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:24.882276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5564f4-2441-421e-966b-30ace3217b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:24.882922 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Volume fb32205e-322e-49fc-bec3-4ef4bbc4fcab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab', 'volume_size': 2, 'source_volid': 'bfd6840d-9a50-4476-9a21-94296363acb2', 'source_volstatus': 'available'}
Sep 06 11:21:24.895952 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:25.120063 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] creating snapshot='volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:21:27.492420 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] cloning 'volume-bfd6840d-9a50-4476-9a21-94296363acb2@volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab.clone_snap' to 'volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:21:29.268352 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Volume volume-bfd6840d-9a50-4476-9a21-94296363acb2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:29.270128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:29.270598 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:29.931585 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] resize volume 'volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab' from 1 to 2 {{(pid=133823) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}}
Sep 06 11:21:29.932296 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:30.222892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Created reservations ['c49c7057-911e-4298-a078-63b744e1207f', 'b15d8d23-63e3-47a1-bad4-b7c2795c4e2f', 'e2e34b6a-43b3-441d-a2f0-aee0a4c37ea2', 'd2112e2e-cc17-46b4-82a6-72329f653b84'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:30.401218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:30.443678 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:30.492168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:30.506085 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Deleted volume successfully.
Sep 06 11:21:30.663120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-106ae44c-be13-4924-9ecd-faec95777207 tempest-VolumesActionsTest-63616406 None] Lock "cinder-58b6e681-6126-487d-9875-8fc18eaacc81-delete_volume" released by "delete_volume" :: held 7.703s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:31.620885 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:UPDATE=24,cinder:DELETE=5,cinder:INSERT=14 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:31.666734 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:21:31.670589 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5564f4-2441-421e-966b-30ace3217b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab', 'volume_size': 2, 'source_volid': 'bfd6840d-9a50-4476-9a21-94296363acb2', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.675279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f172e-4d46-4937-b43f-dd75149b5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.683342 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:31.702713 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (ca3192b0-12da-4284-af4f-0ca2fb8d8090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:31.714090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23baf368-b44e-457a-bb69-291114f63fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.730285 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23baf368-b44e-457a-bb69-291114f63fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119729561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=33dc9034-c7c1-4c56-858a-7f8e0f5e2597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:32Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.735602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cffd47-17b9-4a02-8ec0-ea729957f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.739750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cffd47-17b9-4a02-8ec0-ea729957f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.745418 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b41911-a0cc-49af-b520-a8a300f3e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.749645 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b41911-a0cc-49af-b520-a8a300f3e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33dc9034-c7c1-4c56-858a-7f8e0f5e2597', 'volume_name': 'volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.754611 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cf9796-43a6-471d-8119-64e96d054b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.760081 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cf9796-43a6-471d-8119-64e96d054b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.764821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67097c59-e22e-467d-875d-90feb9bc0b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:31.768265 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Volume 33dc9034-c7c1-4c56-858a-7f8e0f5e2597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597', 'volume_size': 1}
Sep 06 11:21:31.768265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:31.768265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:31.814836 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Volume volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab (fb32205e-322e-49fc-bec3-4ef4bbc4fcab): created successfully
Sep 06 11:21:31.819331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f172e-4d46-4937-b43f-dd75149b5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:31.828493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Flow 'volume_create_manager' (7f5dbd1b-0de4-482c-a1c5-2e71619a234a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:31.969005 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a9ada598-38b6-445d-884c-d2fca8d69a94 tempest-VolumesCloneTest-1174177062 None] Created volume successfully.
Sep 06 11:21:32.271198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Acquiring lock "cinder-fb32205e-322e-49fc-bec3-4ef4bbc4fcab-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:32.281399 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-fb32205e-322e-49fc-bec3-4ef4bbc4fcab-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:32.464473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:32.782703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:33.012450 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] deleting rbd volume volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:33.019568 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:33.019952 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:33.025100 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67097c59-e22e-467d-875d-90feb9bc0b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:33.030122 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0b8a5b-fed3-43eb-beca-e7fe7c32c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:33.137147 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Volume volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597 (33dc9034-c7c1-4c56-858a-7f8e0f5e2597): created successfully
Sep 06 11:21:33.141342 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0b8a5b-fed3-43eb-beca-e7fe7c32c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:33.147263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (ca3192b0-12da-4284-af4f-0ca2fb8d8090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:33.246032 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-61d049a3-f9bb-4961-8b3d-a52e85bfcda1 tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:21:33.961501 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Acquiring lock "cinder-33dc9034-c7c1-4c56-858a-7f8e0f5e2597-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:33.971355 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Lock "cinder-33dc9034-c7c1-4c56-858a-7f8e0f5e2597-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:34.100148 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:34.314134 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:34.314775 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Volume volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:34.429826 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] deleting rbd volume volume-33dc9034-c7c1-4c56-858a-7f8e0f5e2597 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:39.502231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:21:39.703311 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Volume volume-bfd6840d-9a50-4476-9a21-94296363acb2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:39.704093 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] deleting parent snapshot volume-fb32205e-322e-49fc-bec3-4ef4bbc4fcab.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:21:41.783263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Created reservations ['8238b243-46b4-427c-88ac-1f5da606c02b', '70f3693f-6d41-426f-b6eb-7cacc7da9fab', 'd1cc2f1a-fd74-4e34-9e4a-775c402d8999', 'cc8fa791-cf7e-4bf1-b6d1-a25d43945d2b'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:41.800825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Created reservations ['348d5506-e81b-445d-b99d-a561e125eb23', '629634f7-36a1-49c4-9be1-dab25e4db454', '9ff77bea-d723-4be8-b176-2f76b14b10a2', '327fb2bd-c12f-428a-be52-6dc3114a2ed8'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:42.003183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:42.029981 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:42.054052 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:42.060702 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Deleted volume successfully.
Sep 06 11:21:42.163421 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-688c9b6e-228c-49ef-99fb-42daa2e4d4b5 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-fb32205e-322e-49fc-bec3-4ef4bbc4fcab-delete_volume" released by "delete_volume" :: held 9.882s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:42.217119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:42.245390 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:42.280079 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:42.284691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Acquiring lock "cinder-bfd6840d-9a50-4476-9a21-94296363acb2-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:42.289781 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Deleted volume successfully.
Sep 06 11:21:42.298201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-bfd6840d-9a50-4476-9a21-94296363acb2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:42.369803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-55a0a592-4d04-48bf-a9ad-0c07c5d9b579 tempest-VolumesActionsTest-63616406 None] Lock "cinder-33dc9034-c7c1-4c56-858a-7f8e0f5e2597-delete_volume" released by "delete_volume" :: held 8.398s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:42.399891 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:42.508258 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:42.508695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Volume volume-bfd6840d-9a50-4476-9a21-94296363acb2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:42.709195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] deleting rbd volume volume-bfd6840d-9a50-4476-9a21-94296363acb2 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:43.378954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:43.397930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (32658435-5869-4826-80c2-31b6e7eccaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:43.404694 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8ea551-85f9-4929-8d36-dab27b3e1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:43.420535 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8ea551-85f9-4929-8d36-dab27b3e1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1835217634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ffb93b3-3d67-43c1-b298-622ba91b71bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:43Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:43.425712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d77c61-8de7-49f1-bd48-a95538ec12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:43.429730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d77c61-8de7-49f1-bd48-a95538ec12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:43.434694 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db325cfa-cbe9-4045-aa9a-bf4f9f48fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:43.438640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db325cfa-cbe9-4045-aa9a-bf4f9f48fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffb93b3-3d67-43c1-b298-622ba91b71bb', 'volume_name': 'volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:43.443379 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d8339a-a52c-42f0-865b-2f499eb3f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:43.447187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d8339a-a52c-42f0-865b-2f499eb3f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:43.451729 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a37bc-c2bc-40c3-8ff1-e63ec7131247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:43.452768 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Volume 7ffb93b3-3d67-43c1-b298-622ba91b71bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb', 'volume_size': 1}
Sep 06 11:21:43.453163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:43.453908 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:44.135158 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:44.135897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:44.139290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1a37bc-c2bc-40c3-8ff1-e63ec7131247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:44.144123 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1207d69f-307e-4f2a-9586-9a0ac9b9158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:44.234499 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Volume volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb (7ffb93b3-3d67-43c1-b298-622ba91b71bb): created successfully
Sep 06 11:21:44.238338 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1207d69f-307e-4f2a-9586-9a0ac9b9158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:44.244283 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (32658435-5869-4826-80c2-31b6e7eccaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:44.337271 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-268e1952-cda7-4df0-aaf1-31a90acc57ce tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:21:45.617395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Acquiring lock "cinder-7ffb93b3-3d67-43c1-b298-622ba91b71bb-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:45.628493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Lock "cinder-7ffb93b3-3d67-43c1-b298-622ba91b71bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:45.648806 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:45.727300 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:45.891711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:45.892090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Volume volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:46.046416 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] deleting rbd volume volume-7ffb93b3-3d67-43c1-b298-622ba91b71bb {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:47.703259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Created reservations ['2b99d5ce-3627-4075-8f3e-fb64fb72c43b', 'db9e5a9e-8a76-4c21-ba55-e4bdbc0dbd84', 'f8965f29-3a27-4a7c-8ea4-a24fc51651fd', '8a528ab5-17a1-41ca-b548-c5019f96daef'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:47.909297 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:47.936606 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:47.960880 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:47.965779 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Deleted volume successfully.
Sep 06 11:21:48.021267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-6ff86d5b-31da-4e39-a562-197d937f22a8 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-bfd6840d-9a50-4476-9a21-94296363acb2-delete_volume" released by "delete_volume" :: held 5.723s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:48.787452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Acquiring lock "cinder-ab2d995c-9997-4e51-9cd3-4a11897aa411-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:48.793539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-ab2d995c-9997-4e51-9cd3-4a11897aa411-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:48.874687 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:49.016768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:49.179806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] deleting rbd volume volume-ab2d995c-9997-4e51-9cd3-4a11897aa411 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:50.520342 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Created reservations ['092dc39b-f1e0-464a-a598-8a572e2db568', '51e075c6-0b55-4b9b-b186-ed987a82d314', '69b8a676-26cd-49e5-9281-1254baa092fd', '12d07660-21dc-44b7-821e-78b1b40da533'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:50.669569 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:50.692079 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:50.715776 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:50.719734 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Deleted volume successfully.
Sep 06 11:21:50.799908 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f6956c6c-312e-4b72-ace4-8829defbdbc5 tempest-VolumesActionsTest-63616406 None] Lock "cinder-7ffb93b3-3d67-43c1-b298-622ba91b71bb-delete_volume" released by "delete_volume" :: held 5.171s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:51.658766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:51.678206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (e42c8fd1-cc3a-464b-b8e0-b736bcf65dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:51.684508 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f92c42d-1f09-4d66-983a-bdc4c1482ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:51.700146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f92c42d-1f09-4d66-983a-bdc4c1482ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-921675973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6023c15-0fba-48f1-b54d-fdcc1caa8fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:51Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:51.705344 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700aa6f7-67ff-4e08-b6e0-92ce037473f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:51.709447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700aa6f7-67ff-4e08-b6e0-92ce037473f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:51.714934 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9aac23-bc00-4d7c-b889-c2f253f0bda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:51.718861 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9aac23-bc00-4d7c-b889-c2f253f0bda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6023c15-0fba-48f1-b54d-fdcc1caa8fe8', 'volume_name': 'volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:51.723744 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56ab881-a562-456b-a9b2-810e0f5067f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:51.727534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56ab881-a562-456b-a9b2-810e0f5067f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:51.732620 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f62c50-eb2e-43d1-9df9-ca94558fefdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:51.733656 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Volume b6023c15-0fba-48f1-b54d-fdcc1caa8fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8', 'volume_size': 1}
Sep 06 11:21:51.734049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:51.734800 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:52.271899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:52.276323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:52.276323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f62c50-eb2e-43d1-9df9-ca94558fefdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:52.281480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63859df8-9237-4947-9ac0-e61eac8cef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:52.286555 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=52,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:52.372121 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Volume volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8 (b6023c15-0fba-48f1-b54d-fdcc1caa8fe8): created successfully
Sep 06 11:21:52.375746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63859df8-9237-4947-9ac0-e61eac8cef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:52.381460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (e42c8fd1-cc3a-464b-b8e0-b736bcf65dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:52.485998 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5ad795fe-f6fd-4222-a935-ac87eba34731 tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:21:52.852770 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Acquiring lock "cinder-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:52.865713 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Lock "cinder-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:52.956393 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:53.309384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:53.309842 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Volume volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:21:53.464045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] deleting rbd volume volume-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:53.561456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:53.581212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Flow 'volume_create_manager' (a2a9a81a-4752-478e-b8ed-a51756d90bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:53.588179 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8586dc-fa64-4b4a-b9f6-0360b6b1c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:53.604061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8586dc-fa64-4b4a-b9f6-0360b6b1c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1683354664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8c89d61e-6273-422f-9812-cb4473f63060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b360e0ffe64c3bb5897486a18eda10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:53Z,use_quota=True,user_id='226a6d965ff14deebdead8370fc00d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:53.609362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb03487b-f896-4b80-95ae-65e825e96da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:53.613444 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb03487b-f896-4b80-95ae-65e825e96da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:53.618442 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ebbc4-7367-47e3-8ef1-8a8883d62a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:53.622520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ebbc4-7367-47e3-8ef1-8a8883d62a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c89d61e-6273-422f-9812-cb4473f63060', 'volume_name': 'volume-8c89d61e-6273-422f-9812-cb4473f63060', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:53.627376 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34f7264-1501-4b13-ac72-f0cbfc9484bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:53.631274 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34f7264-1501-4b13-ac72-f0cbfc9484bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:53.636181 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1ca7be-3a47-4d0f-a290-3e4b9754d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:53.637251 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume 8c89d61e-6273-422f-9812-cb4473f63060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c89d61e-6273-422f-9812-cb4473f63060', 'volume_size': 1}
Sep 06 11:21:53.637648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] creating volume 'volume-8c89d61e-6273-422f-9812-cb4473f63060' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:53.638292 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:53.922222 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:21:54.199749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] deleting parent snapshot volume-ab2d995c-9997-4e51-9cd3-4a11897aa411.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:21:56.489484 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:21:56.490452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:56.538351 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:56.586999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:56.599153 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:21:56.599614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:21:56.603855 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1ca7be-3a47-4d0f-a290-3e4b9754d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c89d61e-6273-422f-9812-cb4473f63060', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:56.609496 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1cbefd-59a1-496e-a6f0-1ba2b79121ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:56.715423 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume volume-8c89d61e-6273-422f-9812-cb4473f63060 (8c89d61e-6273-422f-9812-cb4473f63060): created successfully
Sep 06 11:21:56.719752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1cbefd-59a1-496e-a6f0-1ba2b79121ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:56.725407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Flow 'volume_create_manager' (a2a9a81a-4752-478e-b8ed-a51756d90bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:56.743471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Created reservations ['36b9ea5e-28c8-4dac-b314-1b9792dffb76', 'af7cf2ef-9a3f-4d8b-98b1-bf697146d94c', 'fe641031-6d35-4358-bae0-e36802d84571', 'e1d38fa5-e0fa-4ebc-abfd-46eb5b07b4f1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:56.806745 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c3c27196-59df-4091-b989-42bed4e2b1db tempest-AttachVolumeShelveTestJSON-1383535698 None] Created volume successfully.
Sep 06 11:21:56.903235 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:56.926565 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:57.042280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:57.047714 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Deleted volume successfully.
Sep 06 11:21:57.127644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4107447a-9320-42f6-a154-5d70bb307ee0 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-ab2d995c-9997-4e51-9cd3-4a11897aa411-delete_volume" released by "delete_volume" :: held 8.334s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:57.430295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Acquiring lock "cinder-45f2350f-dd93-42b0-a5c2-481a4358a6c3-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:21:57.448859 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-45f2350f-dd93-42b0-a5c2-481a4358a6c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:21:57.480430 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Created reservations ['52d1b2ee-dd0b-48a9-8603-d61dc4ca9feb', 'd7db1ed5-0636-4c0f-8cee-5ac623ab892f', '54cff414-8c0d-448a-86d3-b465ad82a5a1', 'a5d01a74-154d-4db7-8f14-5906a6c3ba2d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:21:57.556056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:57.674105 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:21:57.796306 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] deleting rbd volume volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:21:57.955499 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:57.995400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:21:58.057307 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:21:58.069749 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Deleted volume successfully.
Sep 06 11:21:58.166991 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e3f64c21-96ea-45b4-936b-88c6fafa24b7 tempest-VolumesActionsTest-63616406 None] Lock "cinder-b6023c15-0fba-48f1-b54d-fdcc1caa8fe8-delete_volume" released by "delete_volume" :: held 5.301s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:21:59.368895 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=52,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:21:59.472354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:21:59.493178 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (fb709252-dea5-4c70-8d98-cba12ccb51c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:21:59.501089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2559c025-0464-4195-9b29-54bf228ee752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:59.518703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2559c025-0464-4195-9b29-54bf228ee752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2098681514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f361f8f-1224-4685-a19a-5e4a8bd4a9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd7f016fc4fe4a418a5452c85f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:21:59Z,use_quota=True,user_id='236b8011d72b482eb6a61f27130aeb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:59.524340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2c0c6d-adaa-4e27-982a-072fba0ad4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:59.528643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2c0c6d-adaa-4e27-982a-072fba0ad4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:59.534581 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceef840-b485-4f67-ab9f-e1f090e63798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:59.538725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceef840-b485-4f67-ab9f-e1f090e63798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f361f8f-1224-4685-a19a-5e4a8bd4a9e6', 'volume_name': 'volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:59.544022 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e3589c-927c-48eb-b721-6090005a3213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:59.548720 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e3589c-927c-48eb-b721-6090005a3213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:21:59.553634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668cd0cb-65c7-4663-9aa8-0c8c3f91de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:21:59.554927 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Volume 5f361f8f-1224-4685-a19a-5e4a8bd4a9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6', 'volume_size': 1}
Sep 06 11:21:59.555434 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] creating volume 'volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:21:59.558154 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:00.203356 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-a41f2030-6190-46c7-b60b-14c7005865d9 tempest-TaggedBootDevicesTest_v242-571015205 None] Terminate volume connection completed successfully.
Sep 06 11:22:00.203780 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-a41f2030-6190-46c7-b60b-14c7005865d9 tempest-TaggedBootDevicesTest_v242-571015205 None] Deleting attachment bb708106-3919-4d79-abc2-bfb0a052c7e2. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:22:00.431246 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-fb9098c5-051d-461a-a669-a92d2771d863 tempest-TaggedBootDevicesTest_v242-571015205 None] Terminate volume connection completed successfully.
Sep 06 11:22:00.431813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-fb9098c5-051d-461a-a669-a92d2771d863 tempest-TaggedBootDevicesTest_v242-571015205 None] Deleting attachment 6b63df47-e9f6-458c-94c8-76d740b40e79. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:22:00.477064 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:00.477458 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:00.482468 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668cd0cb-65c7-4663-9aa8-0c8c3f91de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:00.487678 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2126e926-9877-450c-838b-a311668d5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:00.571996 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Volume volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6 (5f361f8f-1224-4685-a19a-5e4a8bd4a9e6): created successfully
Sep 06 11:22:00.575944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2126e926-9877-450c-838b-a311668d5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:00.581397 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Flow 'volume_create_manager' (fb709252-dea5-4c70-8d98-cba12ccb51c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:00.611139 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-0f967c83-723b-4fe8-8b32-063d138c5383 tempest-TaggedBootDevicesTest_v242-571015205 None] Terminate volume connection completed successfully.
Sep 06 11:22:00.611586 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a08ce4ab-5e93-4ec6-baa7-1faf7bccc4a6 req-0f967c83-723b-4fe8-8b32-063d138c5383 tempest-TaggedBootDevicesTest_v242-571015205 None] Deleting attachment 99ad532b-5cd4-45eb-b75c-0723ef507238. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:22:00.628716 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b3d0f1c9-9d3a-4f70-85a8-efbe0d87b6f5 tempest-VolumesActionsTest-1756987803 None] Created volume successfully.
Sep 06 11:22:01.081750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:22:01.184115 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] deleting parent snapshot volume-45f2350f-dd93-42b0-a5c2-481a4358a6c3.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:22:03.888384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Acquiring lock "cinder-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:03.906417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Lock "cinder-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:04.076719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:04.280362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:04.280887 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Volume volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:04.349020 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] deleting rbd volume volume-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:04.351323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Created reservations ['d5d315a3-a0a0-4efa-90bf-1090d222c2ae', 'e0c5bc40-885c-41f3-9112-02c18c8b5105', 'c5e25349-a506-4768-b153-7e3c9f616cb2', '7733ebcd-d5c1-41a5-864c-d93c748eaf11'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:04.612779 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:04.638280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:04.662246 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:04.666423 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Deleted volume successfully.
Sep 06 11:22:04.838851 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4ca7e667-749e-4444-8bb7-6b542b5234e1 tempest-VolumesCloneTest-1174177062 None] Lock "cinder-45f2350f-dd93-42b0-a5c2-481a4358a6c3-delete_volume" released by "delete_volume" :: held 7.390s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:06.840548 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:06.914896 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Created reservations ['8fc3ea69-e440-412a-85cb-0a07d254ce78', 'd6a141f3-300f-409d-a910-003917b6e5e5', '5acf16a3-fd4a-48c4-b034-aaad8225467f', 'ee31ac68-8246-4064-bf5a-360a0f348a45'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:07.032072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Acquiring lock "cinder-94a3ca98-6ae6-4403-ac62-4a263bac123e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:07.052564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-94a3ca98-6ae6-4403-ac62-4a263bac123e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:07.147117 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:07.172952 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:07.197350 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:07.214342 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Deleted volume successfully.
Sep 06 11:22:07.221680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:07.388934 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:07.389277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-94a3ca98-6ae6-4403-ac62-4a263bac123e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:07.473169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] deleting rbd volume volume-94a3ca98-6ae6-4403-ac62-4a263bac123e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:07.483591 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a850835f-12b4-4a48-bce1-cf1c0e944cd4 tempest-VolumesActionsTest-1756987803 None] Lock "cinder-5f361f8f-1224-4685-a19a-5e4a8bd4a9e6-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:07.761455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Acquiring lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:07.771483 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:07.877634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:08.023293 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:08.023713 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Volume volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:08.140377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] deleting rbd volume volume-b0bd148b-3427-46d6-a8a7-4898a8bb255e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:08.424858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:22:08.444124 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (2948a9a6-6a59-4465-ba2f-ed1d560150a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:08.450322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09df343e-f3e3-4e47-9b00-0f96ef8036fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:08.466348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09df343e-f3e3-4e47-9b00-0f96ef8036fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-425224155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bacde65f-b842-4019-bc0c-4f70cbe800a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c99417c87d7a4bc182fc787c54bbf3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:22:08Z,use_quota=True,user_id='4eddefe7253d4a5e8d22bf91e971a6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:08.473000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f8ca-f0e5-45d8-b4c5-8e60e2665ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:08.477625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f8ca-f0e5-45d8-b4c5-8e60e2665ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:08.482817 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4012c0-ec72-43d0-ad91-8a9d4ae312e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:08.487375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4012c0-ec72-43d0-ad91-8a9d4ae312e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bacde65f-b842-4019-bc0c-4f70cbe800a6', 'volume_name': 'volume-bacde65f-b842-4019-bc0c-4f70cbe800a6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:08.492061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0070ca4-e1f8-43a8-b508-c0b9b82f2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:08.495804 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0070ca4-e1f8-43a8-b508-c0b9b82f2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:08.500478 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c95ff4-8289-4f20-8c8b-2c20fd43fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:08.501635 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Volume bacde65f-b842-4019-bc0c-4f70cbe800a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bacde65f-b842-4019-bc0c-4f70cbe800a6', 'volume_size': 1}
Sep 06 11:22:08.502041 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] creating volume 'volume-bacde65f-b842-4019-bc0c-4f70cbe800a6' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:22:08.502811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:09.398072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:09.398767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:09.402110 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c95ff4-8289-4f20-8c8b-2c20fd43fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bacde65f-b842-4019-bc0c-4f70cbe800a6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:09.406738 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce5c514-8240-4beb-a092-a896d58fff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:09.487121 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Volume volume-bacde65f-b842-4019-bc0c-4f70cbe800a6 (bacde65f-b842-4019-bc0c-4f70cbe800a6): created successfully
Sep 06 11:22:09.490705 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce5c514-8240-4beb-a092-a896d58fff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:09.496052 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (2948a9a6-6a59-4465-ba2f-ed1d560150a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:09.549281 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a0cd13ca-06b7-4b3d-ad5d-2bf5dedafd18 tempest-VolumesListTestJSON-466210885 None] Created volume successfully.
Sep 06 11:22:11.210946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:22:11.223722 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (3a759fe4-d71c-449b-b1d3-79dfb0f206f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:11.230156 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d0e02-dc32-406e-a83a-c317d0288c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.246789 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988d0e02-dc32-406e-a83a-c317d0288c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-77602916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c99417c87d7a4bc182fc787c54bbf3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:22:11Z,use_quota=True,user_id='4eddefe7253d4a5e8d22bf91e971a6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.252599 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4999582e-c60a-4191-9651-239ed08a3e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.256834 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4999582e-c60a-4191-9651-239ed08a3e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.263038 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef243631-2ee3-4251-990f-3a0dc2b29156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.268120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef243631-2ee3-4251-990f-3a0dc2b29156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd', 'volume_name': 'volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.273743 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be406f45-dc79-4a65-8f42-79f806a60805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.278416 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be406f45-dc79-4a65-8f42-79f806a60805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.284034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae00e31-8a00-447b-8210-74c404eed4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.285283 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Volume 0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd', 'volume_size': 1}
Sep 06 11:22:11.286003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] creating volume 'volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:22:11.286587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:11.795244 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Created reservations ['0b90b8b5-82b2-4cde-85a8-0faa7942c663', '8e38ebca-9493-4648-8b14-f38102f0ea15', 'b079d936-73ee-411c-9f26-68036f48d2b5', '58a7c99d-89cd-4a5e-9ad2-6cccf74acdc0'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:11.843276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:11.843660 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:11.847988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae00e31-8a00-447b-8210-74c404eed4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.852456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da01852-eb0b-4385-9019-50b53e7f8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:11.892602 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:11.925822 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Volume volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd (0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd): created successfully
Sep 06 11:22:11.925822 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da01852-eb0b-4385-9019-50b53e7f8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:11.931035 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (3a759fe4-d71c-449b-b1d3-79dfb0f206f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:12.003788 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-52f7d577-8f0f-481d-bc66-63ac2a6526f7 tempest-VolumesListTestJSON-466210885 None] Created volume successfully.
Sep 06 11:22:12.007920 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:12.039869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:12.081406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:12.088211 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Deleted volume successfully.
Sep 06 11:22:12.217462 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0a978574-f827-453f-b5a1-8ee76b09a32b tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-94a3ca98-6ae6-4403-ac62-4a263bac123e-delete_volume" released by "delete_volume" :: held 5.165s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:12.526370 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Created reservations ['32efede2-49bb-4834-bb36-c358d64757d2', 'd344924f-db22-481f-b812-064fd3638119', '771ffd12-cf06-452c-a085-a2c1544ae858', 'fa634165-9489-4ac9-95d1-75aa2c1aa1f9'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:12.565025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Acquiring lock "cinder-1cfc1bca-12f4-436b-8059-29691621750d-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:12.590173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-1cfc1bca-12f4-436b-8059-29691621750d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:12.698958 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:12.857349 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:12.857917 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Volume volume-1cfc1bca-12f4-436b-8059-29691621750d is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:12.920943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] deleting rbd volume volume-1cfc1bca-12f4-436b-8059-29691621750d {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:12.924261 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:13.043527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:13.198684 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:13.206584 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Deleted volume successfully.
Sep 06 11:22:13.279650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f8801908-686f-4119-9b39-c99a9cc5a64d tempest-VolumesActionsTest-1756987803 None] Lock "cinder-b0bd148b-3427-46d6-a8a7-4898a8bb255e-delete_volume" released by "delete_volume" :: held 5.508s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:14.031933 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:22:14.070160 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (143be9d3-fe18-4873-b9b4-53110ca7301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:14.092659 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7daec7-fa55-419c-8a16-434a9006dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:14.147727 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7daec7-fa55-419c-8a16-434a9006dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1858327917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c07f8b28-592b-4776-a823-e471ed37fea8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c99417c87d7a4bc182fc787c54bbf3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:22:14Z,use_quota=True,user_id='4eddefe7253d4a5e8d22bf91e971a6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:14.152852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0b02a8-7fcb-4dc6-a6de-25f6c76cc15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:14.165857 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0b02a8-7fcb-4dc6-a6de-25f6c76cc15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:14.171164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb3a34-45a2-4ee3-aafc-b189be82ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:14.176068 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb3a34-45a2-4ee3-aafc-b189be82ea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07f8b28-592b-4776-a823-e471ed37fea8', 'volume_name': 'volume-c07f8b28-592b-4776-a823-e471ed37fea8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:14.182263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac1becf-8486-4fc6-b5ca-2e9d2d6b23b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:14.187730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac1becf-8486-4fc6-b5ca-2e9d2d6b23b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:14.194755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc22e7-75e8-45c4-b46b-434541890849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:14.196708 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Volume c07f8b28-592b-4776-a823-e471ed37fea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07f8b28-592b-4776-a823-e471ed37fea8', 'volume_size': 1}
Sep 06 11:22:14.197295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] creating volume 'volume-c07f8b28-592b-4776-a823-e471ed37fea8' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:22:14.198242 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:14.919591 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:14.919591 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:14.922142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc22e7-75e8-45c4-b46b-434541890849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07f8b28-592b-4776-a823-e471ed37fea8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:14.926869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c73b8d7-68a0-436b-9f78-73d7283bf384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:15.012728 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Volume volume-c07f8b28-592b-4776-a823-e471ed37fea8 (c07f8b28-592b-4776-a823-e471ed37fea8): created successfully
Sep 06 11:22:15.016441 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c73b8d7-68a0-436b-9f78-73d7283bf384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:15.028546 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Flow 'volume_create_manager' (143be9d3-fe18-4873-b9b4-53110ca7301c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:15.081415 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0833ab47-687b-417c-a1f0-d80a1426a02e tempest-VolumesListTestJSON-466210885 None] Created volume successfully.
Sep 06 11:22:15.766755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Created reservations ['6e121cbb-d3c8-47a2-bac2-84891fed9b0e', 'dc303d8c-1c39-4c95-9efa-bd24b1720344', 'acfb4d94-7c33-433a-af78-96773709aba7', 'cae30766-4ce4-4321-97c7-705be3bd2a1a'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:16.018122 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:16.099716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:16.159844 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:16.169520 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Deleted volume successfully.
Sep 06 11:22:16.296887 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f73a17ca-a300-435d-9967-76283e38a1a5 tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-1cfc1bca-12f4-436b-8059-29691621750d-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:16.318056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:22:16.345164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (4fa9bd0c-d153-40ac-886c-3f304dd73942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:16.353781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fde6c61-d60f-44d5-8985-29f2635c6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:16.392953 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fde6c61-d60f-44d5-8985-29f2635c6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1985772401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac10c607-f660-481b-b7e3-d3696df6c680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56b93d575b74ba584c4bd399dfe2a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:22:16Z,use_quota=True,user_id='4251298aaf4e4207bdcab24fbdf30728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:16.399706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d5accf-1f4f-429c-ae05-6baab94d939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:16.404264 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d5accf-1f4f-429c-ae05-6baab94d939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:16.409945 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff39407-bedc-460f-9f02-713affd484ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:16.414792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff39407-bedc-460f-9f02-713affd484ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac10c607-f660-481b-b7e3-d3696df6c680', 'volume_name': 'volume-ac10c607-f660-481b-b7e3-d3696df6c680', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:16.419694 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4fd895-4ca3-4e75-85ac-77a91cf602a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:16.424866 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4fd895-4ca3-4e75-85ac-77a91cf602a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:16.431200 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a9e45c-7510-44f6-8191-f1214320b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:16.432572 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Volume ac10c607-f660-481b-b7e3-d3696df6c680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac10c607-f660-481b-b7e3-d3696df6c680', 'volume_size': 1}
Sep 06 11:22:16.435407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] creating volume 'volume-ac10c607-f660-481b-b7e3-d3696df6c680' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:22:16.435407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:17.288902 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Acquiring lock "cinder-ddeb12fb-7b7d-4d13-87e2-c22de50bf482-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:17.303949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-ddeb12fb-7b7d-4d13-87e2-c22de50bf482-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:17.479369 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:17.480056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:17.488221 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a9e45c-7510-44f6-8191-f1214320b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac10c607-f660-481b-b7e3-d3696df6c680', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:17.502340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63abfcc-5ae2-488e-8d07-3e084d5e7527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:17.535609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:17.720628 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:17.786091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] deleting rbd volume volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:17.789336 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Volume volume-ac10c607-f660-481b-b7e3-d3696df6c680 (ac10c607-f660-481b-b7e3-d3696df6c680): created successfully
Sep 06 11:22:17.793742 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63abfcc-5ae2-488e-8d07-3e084d5e7527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:17.807995 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (4fa9bd0c-d153-40ac-886c-3f304dd73942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:17.899750 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f5273d02-7b4d-4e0e-8ee6-812b5b7c4465 tempest-AttachVolumeTestJSON-896955129 None] Created volume successfully.
Sep 06 11:22:19.444700 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 req-beae9a91-6178-4168-bb3e-b8b4b32c7710 tempest-AttachVolumeTestJSON-896955129 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:22:19.775439 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Acquiring lock "cinder-c07f8b28-592b-4776-a823-e471ed37fea8-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:19.798796 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-c07f8b28-592b-4776-a823-e471ed37fea8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:19.822096 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:20.021894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:20.441195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:20.441966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Volume volume-c07f8b28-592b-4776-a823-e471ed37fea8 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:21.178474 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] deleting rbd volume volume-c07f8b28-592b-4776-a823-e471ed37fea8 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:21.182987 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 req-beae9a91-6178-4168-bb3e-b8b4b32c7710 tempest-AttachVolumeTestJSON-896955129 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.738s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:22:21.184749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 req-beae9a91-6178-4168-bb3e-b8b4b32c7710 tempest-AttachVolumeTestJSON-896955129 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac10c607-f660-481b-b7e3-d3696df6c680', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'ac10c607-f660-481b-b7e3-d3696df6c680', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:22:21.327177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 req-beae9a91-6178-4168-bb3e-b8b4b32c7710 tempest-AttachVolumeTestJSON-896955129 None] Connection info returned from driver {'name': 'volumes/volume-ac10c607-f660-481b-b7e3-d3696df6c680', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac10c607-f660-481b-b7e3-d3696df6c680', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '763e3ae1-e423-45b4-a214-32987acb6876'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:22:21.470675 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-ddca9ae1-d139-47a8-b8f5-fc2c0a4148c7 req-beae9a91-6178-4168-bb3e-b8b4b32c7710 tempest-AttachVolumeTestJSON-896955129 None] attachment_update completed successfully.
Sep 06 11:22:22.996696 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:22:23.173633 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] deleting parent snapshot volume-ddeb12fb-7b7d-4d13-87e2-c22de50bf482.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:22:26.049648 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=68,cinder:INSERT=2,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:26.093690 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:22:26.113536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Flow 'volume_create_manager' (1dd924e7-ab07-4ceb-bb40-1da24b7ce69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:26.120548 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9740e99-210c-451a-be80-7a99eade8024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.125616 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Created reservations ['d06cead0-8806-4ab1-8c5b-4fbc4db2da93', '31ed4dd8-ec77-46ee-b8e3-5f0ebb7849e8', 'fb269acb-0941-4e9f-96d4-7da9fb8a70dd', '92721d56-5eab-4662-9486-d76891fc7383'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:26.128620 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Created reservations ['4b6d9caf-2ebe-486d-a175-9edc6f4cb2f8', 'faa87843-96e3-49e3-a74c-5d36a5edc123', '07c82f5a-0b3b-432f-9722-cfb162a51643', '91ba31ac-95b9-435e-aa2a-ca0d2eed78ac'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:26.150527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9740e99-210c-451a-be80-7a99eade8024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1037691010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=120767e7-07f2-4f41-b16b-fd2291be5395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68eec8502e9451b946462adfcc17014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:22:24Z,use_quota=True,user_id='fe7a44f0f8804ece9c80fe34486865a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.156035 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1a8fc0-87fd-49c2-aad2-cc0691acb2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.160240 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1a8fc0-87fd-49c2-aad2-cc0691acb2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.165513 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ebabd-3be6-4f2f-a90c-332a8cbe4e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.169806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ebabd-3be6-4f2f-a90c-332a8cbe4e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120767e7-07f2-4f41-b16b-fd2291be5395', 'volume_name': 'volume-120767e7-07f2-4f41-b16b-fd2291be5395', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.174682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ebd20c-9993-4d04-9562-9749330f5128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.179372 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ebd20c-9993-4d04-9562-9749330f5128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.184009 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5a1f7e-8489-4081-b297-6e40e6b2938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.185098 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Volume 120767e7-07f2-4f41-b16b-fd2291be5395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120767e7-07f2-4f41-b16b-fd2291be5395', 'volume_size': 1}
Sep 06 11:22:26.185602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] creating volume 'volume-120767e7-07f2-4f41-b16b-fd2291be5395' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:22:26.186606 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:26.519127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:26.545492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:26.571094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:26.578195 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Deleted volume successfully.
Sep 06 11:22:26.698731 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:26.768707 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:26.797455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:26.805825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Acquiring lock "cinder-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:26.813144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:22:26.813781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:22:26.820195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5a1f7e-8489-4081-b297-6e40e6b2938c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120767e7-07f2-4f41-b16b-fd2291be5395', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.827257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233d88f0-eb4e-41c8-bac0-766a8dad1ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:22:26.835323 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Deleted volume successfully.
Sep 06 11:22:26.849759 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-52b9016c-4099-46c9-ae06-acb00d967a84 tempest-TaggedBootDevicesTest_v242-571015205 None] Lock "cinder-ddeb12fb-7b7d-4d13-87e2-c22de50bf482-delete_volume" released by "delete_volume" :: held 9.546s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:26.872651 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:26.907120 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Volume volume-120767e7-07f2-4f41-b16b-fd2291be5395 (120767e7-07f2-4f41-b16b-fd2291be5395): created successfully
Sep 06 11:22:26.921954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233d88f0-eb4e-41c8-bac0-766a8dad1ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:22:26.927655 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Flow 'volume_create_manager' (1dd924e7-ab07-4ceb-bb40-1da24b7ce69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:22:26.941645 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-123a4f19-2cb0-4f7e-b42c-3a1ede0bd092 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-c07f8b28-592b-4776-a823-e471ed37fea8-delete_volume" released by "delete_volume" :: held 7.143s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:26.957290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:27.098392 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:27.099003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Volume volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:27.163201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] deleting rbd volume volume-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:27.165907 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e3b7af4b-b4f2-4fe0-b77e-f451fae48607 tempest-VolumesNegativeTest-1672570915 None] Created volume successfully.
Sep 06 11:22:29.829897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Created reservations ['ede117ab-6d42-4997-8dcd-d732a659b0a2', 'c4ed1057-8ecf-45dd-8743-a0d31e3ea0eb', '0bc04629-a2df-49fa-987a-ac6e57a43cfd', 'c481cd44-2511-4854-8145-846f94923999'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:30.013476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:30.090006 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:30.173593 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:30.180874 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Deleted volume successfully.
Sep 06 11:22:30.185715 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=46,cinder:INSERT=10,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:30.240631 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f9c19474-9d56-4ca6-8c59-66004a95d3d4 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-0b8dcaf3-5c47-4cd3-bda3-3d059b7393cd-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:31.201828 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Acquiring lock "cinder-bacde65f-b842-4019-bc0c-4f70cbe800a6-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:31.211767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-bacde65f-b842-4019-bc0c-4f70cbe800a6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:31.389052 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:31.589668 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:31.590699 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Volume volume-bacde65f-b842-4019-bc0c-4f70cbe800a6 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:31.716460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] deleting rbd volume volume-bacde65f-b842-4019-bc0c-4f70cbe800a6 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:22:32.490237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-5a03ae56-3356-4fec-ae33-88af3389cf2d req-246e5271-86d0-479c-8aeb-5a2e77212ee1 tempest-AttachVolumeShelveTestJSON-1383535698 None] No connector for attachment 75109648-1d69-49b7-9f51-5b3ed9b82b31; skipping storage backend terminate_connection call. {{(pid=133823) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}}
Sep 06 11:22:32.490904 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-5a03ae56-3356-4fec-ae33-88af3389cf2d req-246e5271-86d0-479c-8aeb-5a2e77212ee1 tempest-AttachVolumeShelveTestJSON-1383535698 None] Deleting attachment 75109648-1d69-49b7-9f51-5b3ed9b82b31. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:22:34.383937 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Created reservations ['ac32d279-590f-402d-a4ff-406ddb049d17', '86a8198a-80b0-4c80-a4c6-5af6e8767bab', 'a12495a5-44e7-4d3b-8425-88feca12eab6', '8b4a27e9-e82d-464c-8693-31c9d557e457'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:22:34.609090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:34.676969 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:34.861115 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:34.868276 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Deleted volume successfully.
Sep 06 11:22:35.001992 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-73c8c327-32b0-469b-b9c2-656d64cbb659 tempest-VolumesListTestJSON-466210885 None] Lock "cinder-bacde65f-b842-4019-bc0c-4f70cbe800a6-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:22:56.490551 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:22:56.490551 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:56.581000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:56.733989 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:22:56.752497 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:56.753493 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:22:58.349071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Acquiring lock "cinder-120767e7-07f2-4f41-b16b-fd2291be5395-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:22:58.364922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Lock "cinder-120767e7-07f2-4f41-b16b-fd2291be5395-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:22:58.463718 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:22:58.624162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:22:58.624994 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Volume volume-120767e7-07f2-4f41-b16b-fd2291be5395 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:22:58.682170 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] deleting rbd volume volume-120767e7-07f2-4f41-b16b-fd2291be5395 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:23:02.087486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Created reservations ['5e9c956d-8eff-4ca1-9e2d-4a950d36f063', '67982dde-7f6f-4e81-a378-d6bfd2369819', 'd7e80326-2b91-4368-876b-126f61f2cb63', '73cec86d-86d2-4506-a250-859a9e452c4c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:23:02.293823 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:02.361253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:02.452164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:23:02.462378 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Deleted volume successfully.
Sep 06 11:23:02.543813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a41425d0-d6c1-41f4-99b3-166c86716d2d tempest-VolumesNegativeTest-1672570915 None] Lock "cinder-120767e7-07f2-4f41-b16b-fd2291be5395-delete_volume" released by "delete_volume" :: held 4.179s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:23:16.747665 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:23:21.565554 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-25fa4b41-488e-482f-81c5-8125215cf0f1 req-5b10f664-f9d9-45f5-b988-58653feca0b3 tempest-AttachVolumeTestJSON-896955129 None] Terminate volume connection completed successfully.
Sep 06 11:23:21.566232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-25fa4b41-488e-482f-81c5-8125215cf0f1 req-5b10f664-f9d9-45f5-b988-58653feca0b3 tempest-AttachVolumeTestJSON-896955129 None] Deleting attachment 763e3ae1-e423-45b4-a214-32987acb6876. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:23:29.762874 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=27,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:23:29.872449 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:23:29.895613 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Flow 'volume_create_manager' (5acf6e3b-5ea1-4a15-a38b-8a2a26243314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:23:29.902384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bed003-f5ea-4ca4-aa20-8bb9141b72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:29.923302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bed003-f5ea-4ca4-aa20-8bb9141b72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-508561138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5a04c332-6403-4235-995c-5edab6e474c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6767d15bea403e985c76bf6f2f0905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:23:30Z,use_quota=True,user_id='d1ac283e33a040a5ae2b6c85610c16db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:29.928793 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1cb8c7-b702-425d-bc7a-55b58482933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:29.933159 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1cb8c7-b702-425d-bc7a-55b58482933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:29.938253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948a8e1-d951-4040-87a0-4b89a6863d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:30.073629 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948a8e1-d951-4040-87a0-4b89a6863d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a04c332-6403-4235-995c-5edab6e474c3', 'volume_name': 'volume-5a04c332-6403-4235-995c-5edab6e474c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70a38760>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:30.079811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3feffe3f-fa9f-4ea2-989a-a4fff883ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:30.084433 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3feffe3f-fa9f-4ea2-989a-a4fff883ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:30.090364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac27f3-4ad1-4b5e-b0ac-da639453b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:30.091946 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Volume 5a04c332-6403-4235-995c-5edab6e474c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a04c332-6403-4235-995c-5edab6e474c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70a38760>}
Sep 06 11:23:30.092790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Cloning 5a04c332-6403-4235-995c-5edab6e474c3 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:23:30.093802 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:23:30.116113 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:23:30.230599 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 23, 30, 120597)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:23:30.231962 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:23:30.233838 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:23:30.240956 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.123s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:23:30.242290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:23:30.252276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 23, 30, 248998)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:23:30.257002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:23:30.257002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:23:30.271358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:30.470041 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] creating snapshot='volume-5a04c332-6403-4235-995c-5edab6e474c3.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:23:32.070536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-5a04c332-6403-4235-995c-5edab6e474c3.clone_snap' to 'volume-5a04c332-6403-4235-995c-5edab6e474c3' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:23:32.838439 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:23:32.841070 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:23:32.842248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:23:33.104333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:23:33.105383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Marking volume 5a04c332-6403-4235-995c-5edab6e474c3 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:23:33.170047 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 5a04c332-6403-4235-995c-5edab6e474c3. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:23:33.170828 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Creating volume glance metadata for volume 5a04c332-6403-4235-995c-5edab6e474c3 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:23:33.345204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac27f3-4ad1-4b5e-b0ac-da639453b20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a04c332-6403-4235-995c-5edab6e474c3', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70a38760>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:33.352312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45d080-4017-49dc-bebc-f583460fb4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:23:33.436120 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Volume volume-5a04c332-6403-4235-995c-5edab6e474c3 (5a04c332-6403-4235-995c-5edab6e474c3): created successfully
Sep 06 11:23:33.440471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45d080-4017-49dc-bebc-f583460fb4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:23:33.447606 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Flow 'volume_create_manager' (5acf6e3b-5ea1-4a15-a38b-8a2a26243314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:23:33.544570 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0449213b-4e23-4e96-84df-ed9bba5c0270 tempest-TestVolumeBackupRestore-739971810 None] Created volume successfully.
Sep 06 11:23:34.996793 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:23:34Z,data_timestamp=2022-09-06T11:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cd1fbc06-8525-4788-87bf-38021c4fceb1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9d6767d15bea403e985c76bf6f2f0905',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d1ac283e33a040a5ae2b6c85610c16db',volume_id=5a04c332-6403-4235-995c-5edab6e474c3)
Sep 06 11:23:35.001926 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] continue_backup in rpcapi backup_id cd1fbc06-8525-4788-87bf-38021c4fceb1 {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:23:35.124173 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:23:36.121511 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.997s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:23:36.124327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5a04c332-6403-4235-995c-5edab6e474c3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '5a04c332-6403-4235-995c-5edab6e474c3', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:23:36.146777 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] Initialize volume connection completed successfully.
Sep 06 11:23:42.526942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Acquiring lock "cinder-8c89d61e-6273-422f-9812-cb4473f63060-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:23:42.556999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Lock "cinder-8c89d61e-6273-422f-9812-cb4473f63060-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:23:42.669068 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:43.191299 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:23:43.191961 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume volume-8c89d61e-6273-422f-9812-cb4473f63060 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:23:43.373680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] deleting rbd volume volume-8c89d61e-6273-422f-9812-cb4473f63060 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:23:52.657446 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=39,cinder:UPDATE=6,cinder:INSERT=7 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:23:52.773706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Created reservations ['499f27f3-cec9-44f1-beaf-1947afee10ae', '7d78e247-b915-4978-877d-1bb1776fdaf2', 'a54d2110-3745-491b-8862-0e28f79884e1', '5de94ff3-d3fc-42b3-9dd7-6e93670bea3e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:23:53.051394 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:53.089008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:53.156689 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:23:53.170144 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Deleted volume successfully.
Sep 06 11:23:53.250858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-3d1c6c0b-ab8c-4f6f-ab4c-590ad274c9d7 tempest-AttachVolumeShelveTestJSON-1383535698 None] Lock "cinder-8c89d61e-6273-422f-9812-cb4473f63060-delete_volume" released by "delete_volume" :: held 10.694s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:23:53.615932 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Acquiring lock "cinder-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:23:53.630461 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Lock "cinder-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:23:53.725359 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:54.350094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:23:54.350869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Volume volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:23:54.732286 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] deleting rbd volume volume-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:23:56.486621 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:23:56.487574 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:56.538197 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:23:56.603193 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:24:06.290221 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=39,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:24:06.482244 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Created reservations ['d87c11ec-b67c-4b76-b94d-060f133a3e8d', 'ebf37f13-443b-4048-8a15-b48ffdac9824', '5e6ddbc3-905d-45ec-b0fa-67a4faf8aea9', '55e63543-e9b1-4904-a9f9-a7fa40e43a36'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:24:06.665265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:06.691326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:06.722830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:24:06.728759 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Deleted volume successfully.
Sep 06 11:24:06.799280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-20cac045-e6eb-4147-95d2-2c5cfadd6d70 tempest-AttachVolumeShelveTestJSON-1383535698 None] Lock "cinder-a65b0ac0-1d9b-4861-a8d7-894c6b3e5846-delete_volume" released by "delete_volume" :: held 13.169s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:24:16.741296 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:24:26.570894 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] Terminate volume connection completed successfully.
Sep 06 11:24:26.590303 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e5ed791f-673c-4b16-83fb-9e106e6ee320 tempest-TestVolumeBackupRestore-739971810 None] Remove volume export completed successfully.
Sep 06 11:24:28.415586 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:24:28.437261 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Flow 'volume_create_manager' (c6232561-ecf5-4db3-ad5e-6eed46bba083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:24:28.443665 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a1fa77-ae7d-47be-94c9-34e30601fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:28.459578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a1fa77-ae7d-47be-94c9-34e30601fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:24:28Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_cd1fbc06-8525-4788-87bf-38021c4fceb1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f9029e9-670e-487d-b4bf-6eb74e504b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6767d15bea403e985c76bf6f2f0905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:24:28Z,use_quota=True,user_id='d1ac283e33a040a5ae2b6c85610c16db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:28.464900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75fff2f-2f0c-414a-9f83-950ae56e0c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:28.469311 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75fff2f-2f0c-414a-9f83-950ae56e0c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:28.474683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024ef652-7595-4cc0-8393-ade23b65a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:28.479246 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024ef652-7595-4cc0-8393-ade23b65a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9029e9-670e-487d-b4bf-6eb74e504b25', 'volume_name': 'volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:28.484090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319ecc74-30be-4579-9d78-14ede09c5dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:28.496300 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319ecc74-30be-4579-9d78-14ede09c5dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:28.503928 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba11d209-7970-4d7d-a370-3ea3da2c8a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:28.505089 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Volume 4f9029e9-670e-487d-b4bf-6eb74e504b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'volume_size': 1}
Sep 06 11:24:28.505496 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] creating volume 'volume-4f9029e9-670e-487d-b4bf-6eb74e504b25' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:24:28.506779 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:28.979349 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:24:28.979730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:24:28.984452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba11d209-7970-4d7d-a370-3ea3da2c8a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:28.991635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3afb80b-ce78-420d-b1ae-2a40c9b0c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:29.071020 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Volume volume-4f9029e9-670e-487d-b4bf-6eb74e504b25 (4f9029e9-670e-487d-b4bf-6eb74e504b25): created successfully
Sep 06 11:24:29.074762 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3afb80b-ce78-420d-b1ae-2a40c9b0c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:29.080318 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Flow 'volume_create_manager' (c6232561-ecf5-4db3-ad5e-6eed46bba083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:24:29.167853 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Created volume successfully.
Sep 06 11:24:29.439312 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:24:30.207995 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.768s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:24:30.208928 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4f9029e9-670e-487d-b4bf-6eb74e504b25', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:24:30.229333 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Initialize volume connection completed successfully.
Sep 06 11:24:36.751283 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:24:50.920874 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:24:51.012404 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:24:51.047845 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (b2537f26-0736-450d-87d7-89406a840ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:24:51.052217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cad864e-c84c-4c74-8f82-fbb2e20e3d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:51.069363 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cad864e-c84c-4c74-8f82-fbb2e20e3d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-32964891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=553c3814-3972-4737-be00-ff7beaefc711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6a64ebac2146b9a92c0ed0ac76a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:24:51Z,use_quota=True,user_id='5458eb197e36456fb7785c8625ed3140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:51.074499 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43ac35f-4fbe-4263-a0ba-e533b38ca28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:51.078605 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43ac35f-4fbe-4263-a0ba-e533b38ca28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:51.083609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d91963c-add5-46e2-b1a9-b1e023b0e3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:51.087576 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d91963c-add5-46e2-b1a9-b1e023b0e3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553c3814-3972-4737-be00-ff7beaefc711', 'volume_name': 'volume-553c3814-3972-4737-be00-ff7beaefc711', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:51.092346 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735104e7-b4a7-4831-af6c-6411c041ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:51.096309 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735104e7-b4a7-4831-af6c-6411c041ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:51.100909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85567b45-e71e-405e-9a87-0ffb207ae779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:51.101976 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Volume 553c3814-3972-4737-be00-ff7beaefc711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553c3814-3972-4737-be00-ff7beaefc711', 'volume_size': 1}
Sep 06 11:24:51.102392 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] creating volume 'volume-553c3814-3972-4737-be00-ff7beaefc711' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:24:51.103174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:52.931916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:24:52.932605 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:24:52.936816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85567b45-e71e-405e-9a87-0ffb207ae779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553c3814-3972-4737-be00-ff7beaefc711', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:52.942728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea78a16-2f10-4159-bcee-dfbbd3f8ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:24:52.997442 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-553c3814-3972-4737-be00-ff7beaefc711 (553c3814-3972-4737-be00-ff7beaefc711): created successfully
Sep 06 11:24:53.001080 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea78a16-2f10-4159-bcee-dfbbd3f8ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:24:53.006356 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (b2537f26-0736-450d-87d7-89406a840ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:24:53.105250 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5f465c0f-7d95-40ff-8de7-592f684d687b tempest-AttachVolumeNegativeTest-423464195 None] Created volume successfully.
Sep 06 11:24:55.153647 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-41dc1167-ea38-404d-b595-4c789cd74a76 req-eb45d7cd-2bdd-4987-bf2b-3744cfb14755 tempest-AttachVolumeNegativeTest-423464195 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:24:55.935503 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-41dc1167-ea38-404d-b595-4c789cd74a76 req-eb45d7cd-2bdd-4987-bf2b-3744cfb14755 tempest-AttachVolumeNegativeTest-423464195 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.781s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:24:55.936343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-41dc1167-ea38-404d-b595-4c789cd74a76 req-eb45d7cd-2bdd-4987-bf2b-3744cfb14755 tempest-AttachVolumeNegativeTest-423464195 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-553c3814-3972-4737-be00-ff7beaefc711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '553c3814-3972-4737-be00-ff7beaefc711', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:24:56.060708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-41dc1167-ea38-404d-b595-4c789cd74a76 req-eb45d7cd-2bdd-4987-bf2b-3744cfb14755 tempest-AttachVolumeNegativeTest-423464195 None] Connection info returned from driver {'name': 'volumes/volume-553c3814-3972-4737-be00-ff7beaefc711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '553c3814-3972-4737-be00-ff7beaefc711', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fd6a8d31-8b57-4047-997c-29c3c1e3fd0d'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:24:56.222256 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-41dc1167-ea38-404d-b595-4c789cd74a76 req-eb45d7cd-2bdd-4987-bf2b-3744cfb14755 tempest-AttachVolumeNegativeTest-423464195 None] attachment_update completed successfully.
Sep 06 11:24:56.488052 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:24:56.488909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:56.514459 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:24:56.539805 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:25:03.290701 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:25:03.317895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (10e283c2-5481-48fc-a5d5-4f20304bedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:25:03.326648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2ce23-6333-4468-8ddd-a16ea6e083be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:03.347460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2ce23-6333-4468-8ddd-a16ea6e083be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-520795959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=13b827d7-c255-46e0-b141-540d01cae8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56b93d575b74ba584c4bd399dfe2a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:25:03Z,use_quota=True,user_id='4251298aaf4e4207bdcab24fbdf30728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:03.354395 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a504e2-0679-4af1-9e03-4f943e6c9954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:03.360794 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a504e2-0679-4af1-9e03-4f943e6c9954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:03.367470 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94438c55-bfe3-46af-88f8-1c3ac3492e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:03.371707 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94438c55-bfe3-46af-88f8-1c3ac3492e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b827d7-c255-46e0-b141-540d01cae8f0', 'volume_name': 'volume-13b827d7-c255-46e0-b141-540d01cae8f0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:03.376436 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7adacf-de9e-48d2-ae05-1103021c53b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:03.380602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7adacf-de9e-48d2-ae05-1103021c53b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:03.385135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8537fb3-1590-4acf-89d9-457b49745c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:03.386221 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Volume 13b827d7-c255-46e0-b141-540d01cae8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b827d7-c255-46e0-b141-540d01cae8f0', 'volume_size': 1}
Sep 06 11:25:03.386620 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] creating volume 'volume-13b827d7-c255-46e0-b141-540d01cae8f0' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:25:03.387296 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:05.395658 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:25:05.396347 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:25:05.400054 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8537fb3-1590-4acf-89d9-457b49745c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b827d7-c255-46e0-b141-540d01cae8f0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:05.404778 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc3aec6-e74e-4376-bcb9-7c45ac0d7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:05.535456 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Volume volume-13b827d7-c255-46e0-b141-540d01cae8f0 (13b827d7-c255-46e0-b141-540d01cae8f0): created successfully
Sep 06 11:25:05.539856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc3aec6-e74e-4376-bcb9-7c45ac0d7431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:05.545143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (10e283c2-5481-48fc-a5d5-4f20304bedbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:25:05.660868 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dfe59b0c-d182-451e-a35c-ce89388b84a8 tempest-AttachVolumeTestJSON-896955129 None] Created volume successfully.
Sep 06 11:25:07.589071 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:25:07.601352 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 req-098c29c4-21a7-4295-b27c-af90868c9572 tempest-AttachVolumeTestJSON-896955129 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:25:08.411976 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 req-098c29c4-21a7-4295-b27c-af90868c9572 tempest-AttachVolumeTestJSON-896955129 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.810s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:25:08.412811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 req-098c29c4-21a7-4295-b27c-af90868c9572 tempest-AttachVolumeTestJSON-896955129 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-13b827d7-c255-46e0-b141-540d01cae8f0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '13b827d7-c255-46e0-b141-540d01cae8f0', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:25:08.500640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 req-098c29c4-21a7-4295-b27c-af90868c9572 tempest-AttachVolumeTestJSON-896955129 None] Connection info returned from driver {'name': 'volumes/volume-13b827d7-c255-46e0-b141-540d01cae8f0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '13b827d7-c255-46e0-b141-540d01cae8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1e8c848-b9fd-45b3-9e81-ebd59651aed1'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:25:08.690681 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-f2dd6f4a-2811-4b38-b798-7825d2baeb18 req-098c29c4-21a7-4295-b27c-af90868c9572 tempest-AttachVolumeTestJSON-896955129 None] attachment_update completed successfully.
Sep 06 11:25:13.929939 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:25:13.955400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (d094e558-a095-48fb-9680-4b15e4469c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:25:13.962296 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b39940-d4b9-4dbb-8ecb-71fdd209f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:13.980320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b39940-d4b9-4dbb-8ecb-71fdd209f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1107754955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fea7ae22-657e-44ae-b515-35c7f52c5d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56b93d575b74ba584c4bd399dfe2a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:25:14Z,use_quota=True,user_id='4251298aaf4e4207bdcab24fbdf30728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:13.985905 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eb2ead-5915-455a-87c1-654affe2bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:13.990497 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eb2ead-5915-455a-87c1-654affe2bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:13.996150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638543c4-3368-44a6-ad6c-0bd486d9de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:14.000556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638543c4-3368-44a6-ad6c-0bd486d9de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea7ae22-657e-44ae-b515-35c7f52c5d73', 'volume_name': 'volume-fea7ae22-657e-44ae-b515-35c7f52c5d73', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:14.005992 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edda537-56e0-451f-a407-9a5f0a2d4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:14.010178 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edda537-56e0-451f-a407-9a5f0a2d4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:14.015051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08e18c-f07c-4dfe-a16c-a40d8f04ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:14.016103 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Volume fea7ae22-657e-44ae-b515-35c7f52c5d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea7ae22-657e-44ae-b515-35c7f52c5d73', 'volume_size': 1}
Sep 06 11:25:14.016515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] creating volume 'volume-fea7ae22-657e-44ae-b515-35c7f52c5d73' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:25:14.017536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:14.443547 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:25:14.443949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:25:14.447790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08e18c-f07c-4dfe-a16c-a40d8f04ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea7ae22-657e-44ae-b515-35c7f52c5d73', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:14.452272 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d3eb40-d573-451d-a0e7-187c0405c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:25:14.523502 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Volume volume-fea7ae22-657e-44ae-b515-35c7f52c5d73 (fea7ae22-657e-44ae-b515-35c7f52c5d73): created successfully
Sep 06 11:25:14.537186 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d3eb40-d573-451d-a0e7-187c0405c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:25:14.547323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Flow 'volume_create_manager' (d094e558-a095-48fb-9680-4b15e4469c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:25:14.643223 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-adcd7a7d-8754-4c4b-bde7-89a6be7e61dc tempest-AttachVolumeTestJSON-896955129 None] Created volume successfully.
Sep 06 11:25:16.189828 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-de302df9-d809-464f-80f4-25b02f53eb51 req-3d150f96-f4e0-45c9-b0de-8cb6c4da0c1e tempest-AttachVolumeTestJSON-896955129 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:25:17.066552 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-de302df9-d809-464f-80f4-25b02f53eb51 req-3d150f96-f4e0-45c9-b0de-8cb6c4da0c1e tempest-AttachVolumeTestJSON-896955129 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.877s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:25:17.069543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-de302df9-d809-464f-80f4-25b02f53eb51 req-3d150f96-f4e0-45c9-b0de-8cb6c4da0c1e tempest-AttachVolumeTestJSON-896955129 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fea7ae22-657e-44ae-b515-35c7f52c5d73', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'fea7ae22-657e-44ae-b515-35c7f52c5d73', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:25:17.192257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-de302df9-d809-464f-80f4-25b02f53eb51 req-3d150f96-f4e0-45c9-b0de-8cb6c4da0c1e tempest-AttachVolumeTestJSON-896955129 None] Connection info returned from driver {'name': 'volumes/volume-fea7ae22-657e-44ae-b515-35c7f52c5d73', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fea7ae22-657e-44ae-b515-35c7f52c5d73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7feff723-9922-4382-b4b8-0b313d610688'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:25:17.416841 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-de302df9-d809-464f-80f4-25b02f53eb51 req-3d150f96-f4e0-45c9-b0de-8cb6c4da0c1e tempest-AttachVolumeTestJSON-896955129 None] attachment_update completed successfully.
Sep 06 11:25:17.662689 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Terminate volume connection completed successfully.
Sep 06 11:25:17.683883 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-50af2d43-9734-4312-a1bc-520f85342dfd tempest-TestVolumeBackupRestore-739971810 None] Remove volume export completed successfully.
Sep 06 11:25:21.742270 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-8029e2bb-5a52-441c-b324-3aeba01a55be req-dc8391b4-00c7-4422-9865-5a884e6b90b6 tempest-AttachVolumeTestJSON-896955129 None] Terminate volume connection completed successfully.
Sep 06 11:25:21.742270 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-8029e2bb-5a52-441c-b324-3aeba01a55be req-dc8391b4-00c7-4422-9865-5a884e6b90b6 tempest-AttachVolumeTestJSON-896955129 None] Deleting attachment d1e8c848-b9fd-45b3-9e81-ebd59651aed1. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:25:23.357846 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=52,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:25:23.368894 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-71274757-b98a-439c-80a8-f24791429cbb req-c9adbbfd-2c51-42cc-8425-17c8f9065cd8 tempest-AttachVolumeTestJSON-896955129 None] Terminate volume connection completed successfully.
Sep 06 11:25:23.369351 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-71274757-b98a-439c-80a8-f24791429cbb req-c9adbbfd-2c51-42cc-8425-17c8f9065cd8 tempest-AttachVolumeTestJSON-896955129 None] Deleting attachment 7feff723-9922-4382-b4b8-0b313d610688. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:25:27.708241 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 req-fd8e90ba-21fe-4001-978c-d41caa747207 tempest-TestVolumeBackupRestore-739971810 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:25:28.952427 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 req-fd8e90ba-21fe-4001-978c-d41caa747207 tempest-TestVolumeBackupRestore-739971810 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.243s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:25:28.953571 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 req-fd8e90ba-21fe-4001-978c-d41caa747207 tempest-TestVolumeBackupRestore-739971810 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4f9029e9-670e-487d-b4bf-6eb74e504b25', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:25:29.203626 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 req-fd8e90ba-21fe-4001-978c-d41caa747207 tempest-TestVolumeBackupRestore-739971810 None] Connection info returned from driver {'name': 'volumes/volume-4f9029e9-670e-487d-b4bf-6eb74e504b25', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4f9029e9-670e-487d-b4bf-6eb74e504b25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0529e70c-bc24-490f-b50f-a9f5b65a7b08'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:25:29.396609 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-0d8f25ff-5248-4c68-93f6-5aad3e6bfd40 req-fd8e90ba-21fe-4001-978c-d41caa747207 tempest-TestVolumeBackupRestore-739971810 None] attachment_update completed successfully.
Sep 06 11:25:31.153987 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Acquiring lock "cinder-fea7ae22-657e-44ae-b515-35c7f52c5d73-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:25:31.163097 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-fea7ae22-657e-44ae-b515-35c7f52c5d73-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:25:31.246146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:31.402443 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:25:31.402893 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Volume volume-fea7ae22-657e-44ae-b515-35c7f52c5d73 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:25:31.460410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] deleting rbd volume volume-fea7ae22-657e-44ae-b515-35c7f52c5d73 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:25:34.775675 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Created reservations ['0c5611e8-27e0-47d9-b673-407d60fde35b', 'd95aaaad-25b6-4ce8-a99c-92f4e970ac16', '550759eb-cc2a-4aee-aecf-ecc320a1c0f4', '8ed09ee5-1256-4721-8907-73c5e7f239ad'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:25:34.992128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:35.027619 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:35.063119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:25:35.067912 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Deleted volume successfully.
Sep 06 11:25:35.161900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f066b869-6e33-4448-90fe-bb87a401a5f9 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-fea7ae22-657e-44ae-b515-35c7f52c5d73-delete_volume" released by "delete_volume" :: held 3.999s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:25:35.617944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Acquiring lock "cinder-13b827d7-c255-46e0-b141-540d01cae8f0-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:25:35.629476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-13b827d7-c255-46e0-b141-540d01cae8f0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:25:35.761212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:35.922518 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:25:35.926998 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Volume volume-13b827d7-c255-46e0-b141-540d01cae8f0 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:25:36.072243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] deleting rbd volume volume-13b827d7-c255-46e0-b141-540d01cae8f0 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:25:39.476423 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=58,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:25:39.637806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Created reservations ['a017f746-02f1-454a-ad6e-0fb89f01fb1b', '0003fa63-40bb-4885-9fb4-2c1e423a720a', 'fe408215-29c0-4905-ad20-25fbdc182161', 'ad14f4af-3107-404c-b5de-d4b5ab65f004'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:25:39.857187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:39.931866 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:40.002949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:25:40.007583 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Deleted volume successfully.
Sep 06 11:25:40.117243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-5f5625e7-4939-464b-b5b1-ae9ad8353633 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-13b827d7-c255-46e0-b141-540d01cae8f0-delete_volume" released by "delete_volume" :: held 4.488s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:25:40.345155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Acquiring lock "cinder-ac10c607-f660-481b-b7e3-d3696df6c680-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:25:40.362201 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-ac10c607-f660-481b-b7e3-d3696df6c680-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:25:40.472090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:40.643298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:25:40.644071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Volume volume-ac10c607-f660-481b-b7e3-d3696df6c680 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:25:40.734769 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] deleting rbd volume volume-ac10c607-f660-481b-b7e3-d3696df6c680 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:25:44.283459 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Created reservations ['a07f7f9d-2168-4d36-84a9-457d45a22963', 'dff6f7bd-873b-48bb-9705-1178038c2d22', '08240e97-865d-45e9-b949-3ba947860c03', 'b1c1e1d5-5684-4678-8947-98ccad457063'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:25:44.494544 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=56,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:25:44.616437 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:44.652089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:44.722684 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:25:44.733659 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Deleted volume successfully.
Sep 06 11:25:44.872731 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1b1def9d-0b73-43c0-a72e-9fbc6ed7a454 tempest-AttachVolumeTestJSON-896955129 None] Lock "cinder-ac10c607-f660-481b-b7e3-d3696df6c680-delete_volume" released by "delete_volume" :: held 4.511s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:25:56.485618 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:25:56.491146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:56.520357 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:25:56.546425 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:26:03.005302 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-9911185c-ea00-4541-9764-b3f7d66cbb40 req-9331aeef-7303-4674-b4af-a4718428e877 tempest-AttachVolumeNegativeTest-423464195 None] Terminate volume connection completed successfully.
Sep 06 11:26:03.006023 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-9911185c-ea00-4541-9764-b3f7d66cbb40 req-9331aeef-7303-4674-b4af-a4718428e877 tempest-AttachVolumeNegativeTest-423464195 None] Deleting attachment fd6a8d31-8b57-4047-997c-29c3c1e3fd0d. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:26:16.755629 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:26:16.756270 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:26:36.765889 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:26:56.484054 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:26:56.484054 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:26:56.522091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:26:56.573114 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:26:56.769608 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:27:04.554077 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:27:04.576031 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (c549c3f8-28a1-4983-b344-ca2f3b19582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:27:04.586583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b400ab42-b6d8-4550-ae70-6713aaa337cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:04.600649 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b400ab42-b6d8-4550-ae70-6713aaa337cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-825509158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7802977-f4fe-4eec-a9a4-6c7e555ce808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6a64ebac2146b9a92c0ed0ac76a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:27:04Z,use_quota=True,user_id='5458eb197e36456fb7785c8625ed3140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:04.606798 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dda16e-70e0-44b7-83e6-22b0dcaa4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:04.615287 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dda16e-70e0-44b7-83e6-22b0dcaa4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:04.616173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2102886-5c5c-4423-b182-6b2514cfe35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:04.620199 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2102886-5c5c-4423-b182-6b2514cfe35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'volume_name': 'volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:04.625379 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4405716e-fc14-4b24-a9c4-bc9b72f83f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:04.629749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4405716e-fc14-4b24-a9c4-bc9b72f83f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:04.634318 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca8f57c-1f01-4da3-b36a-c15e2fce3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:04.635407 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Volume e7802977-f4fe-4eec-a9a4-6c7e555ce808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'volume_size': 1}
Sep 06 11:27:04.635925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] creating volume 'volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:27:04.636700 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:05.768773 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:27:05.769399 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:27:05.773663 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca8f57c-1f01-4da3-b36a-c15e2fce3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:05.778728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a018ca-56e5-46ef-b861-b71519ad7190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:05.900909 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808 (e7802977-f4fe-4eec-a9a4-6c7e555ce808): created successfully
Sep 06 11:27:05.913241 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a018ca-56e5-46ef-b861-b71519ad7190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:05.920760 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (c549c3f8-28a1-4983-b344-ca2f3b19582a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:27:06.054752 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1cb59ea5-828f-457c-bc3d-0d1983f29e4c tempest-AttachVolumeNegativeTest-423464195 None] Created volume successfully.
Sep 06 11:27:07.777177 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:27:07.785129 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-67b8992c-16bb-4548-add6-bfaaef3637fe req-bd45040e-7308-4fb0-ba73-edc0bd76ab26 tempest-AttachVolumeNegativeTest-423464195 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:27:08.679898 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-67b8992c-16bb-4548-add6-bfaaef3637fe req-bd45040e-7308-4fb0-ba73-edc0bd76ab26 tempest-AttachVolumeNegativeTest-423464195 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:27:08.680725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-67b8992c-16bb-4548-add6-bfaaef3637fe req-bd45040e-7308-4fb0-ba73-edc0bd76ab26 tempest-AttachVolumeNegativeTest-423464195 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:27:08.830984 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-67b8992c-16bb-4548-add6-bfaaef3637fe req-bd45040e-7308-4fb0-ba73-edc0bd76ab26 tempest-AttachVolumeNegativeTest-423464195 None] Connection info returned from driver {'name': 'volumes/volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e7802977-f4fe-4eec-a9a4-6c7e555ce808', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8273cf7e-27e0-4938-8fae-8398bc8bc18a'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:27:08.986700 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-67b8992c-16bb-4548-add6-bfaaef3637fe req-bd45040e-7308-4fb0-ba73-edc0bd76ab26 tempest-AttachVolumeNegativeTest-423464195 None] attachment_update completed successfully.
Sep 06 11:27:13.497446 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-dd95e972-34c6-443e-b379-d1e895918148 req-41e31a1f-ad62-4ef6-997c-4402fe25ef2b tempest-AttachVolumeNegativeTest-423464195 None] Terminate volume connection completed successfully.
Sep 06 11:27:13.498131 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-dd95e972-34c6-443e-b379-d1e895918148 req-41e31a1f-ad62-4ef6-997c-4402fe25ef2b tempest-AttachVolumeNegativeTest-423464195 None] Deleting attachment 8273cf7e-27e0-4938-8fae-8398bc8bc18a. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:27:28.519635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0820dbdb-8621-4c25-b5d2-f01e658455a3 tempest-BackendsCapabilitiesAdminTestsJSON-943169649 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:4daa98dc-5b12-4182-9225-fdb178ab05f0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133823) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Sep 06 11:27:28.567990 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ffc0f523-da16-4108-b8f9-606b7053e63d tempest-BackendsCapabilitiesAdminTestsJSON-943169649 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:4daa98dc-5b12-4182-9225-fdb178ab05f0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133823) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Sep 06 11:27:34.298276 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=21,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:27:34.308038 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c3881d38-a0c2-4491-b0ed-3e8901d2a01f tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-954613726: creating
Sep 06 11:27:34.494374 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c3881d38-a0c2-4491-b0ed-3e8901d2a01f tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-954613726: created successfully
Sep 06 11:27:34.504180 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c3881d38-a0c2-4491-b0ed-3e8901d2a01f tempest-GroupSnapshotsTest-1911921834 None] Create group completed successfully.
Sep 06 11:27:36.668030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:27:36.688280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (56408c4d-6f04-42dc-abe3-8f0744974c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:27:36.694627 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f221dedf-5839-4531-b55f-cf6a6c4c27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:36.715528 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f221dedf-5839-4531-b55f-cf6a6c4c27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1586639037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=638c0f85-5e28-4fc9-b914-6d27a8b1c703,host='ncdv-master-1@ceph#ceph',id=2604484d-827d-44c0-bb71-0495236d04ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a54585a3c64c59a4a54488fa051d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:27:36Z,use_quota=True,user_id='0ec431fb2f40416f9c6c5fa2775634ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c654727b-0a15-4614-a63f-af6640027538),volume_type_id=c654727b-0a15-4614-a63f-af6640027538)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:36.717559 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e64f3f-d3bb-45bf-8281-fe8c5c4d304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:36.722218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e64f3f-d3bb-45bf-8281-fe8c5c4d304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:36.727380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6829a0-a24f-4be3-b05d-9945d2860252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:36.731373 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6829a0-a24f-4be3-b05d-9945d2860252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2604484d-827d-44c0-bb71-0495236d04ec', 'volume_name': 'volume-2604484d-827d-44c0-bb71-0495236d04ec', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:36.738429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1898a29e-2efa-4223-b90d-77768bbfdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:36.740140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1898a29e-2efa-4223-b90d-77768bbfdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:36.744635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9ed429-df0f-4cb2-8401-4b495616ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:36.745766 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Volume 2604484d-827d-44c0-bb71-0495236d04ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2604484d-827d-44c0-bb71-0495236d04ec', 'volume_size': 1}
Sep 06 11:27:36.746166 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] creating volume 'volume-2604484d-827d-44c0-bb71-0495236d04ec' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:27:36.746916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:37.877827 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:27:37.880194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:27:37.885144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9ed429-df0f-4cb2-8401-4b495616ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2604484d-827d-44c0-bb71-0495236d04ec', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:37.890258 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bafe47-40fe-4b2a-82f8-5025abeeb16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:27:38.069777 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-2604484d-827d-44c0-bb71-0495236d04ec (2604484d-827d-44c0-bb71-0495236d04ec): created successfully
Sep 06 11:27:38.073173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bafe47-40fe-4b2a-82f8-5025abeeb16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:27:38.081295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (56408c4d-6f04-42dc-abe3-8f0744974c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:27:38.085545 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=29,cinder:UPDATE=8 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:27:38.186560 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-18393cf7-ee67-4b3b-b184-c6ca1851ff98 tempest-GroupSnapshotsTest-1911921834 None] Created volume successfully.
Sep 06 11:27:39.274533 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-eddb8a30-36cc-435f-b930-d8fa410ff13a tempest-GroupSnapshotsTest-1911921834 None] GroupSnapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: creating.
Sep 06 11:27:39.312469 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-eddb8a30-36cc-435f-b930-d8fa410ff13a tempest-GroupSnapshotsTest-1911921834 None] Group snapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: creating. {{(pid=133823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Sep 06 11:27:39.331761 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eddb8a30-36cc-435f-b930-d8fa410ff13a tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:44.265609 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-eddb8a30-36cc-435f-b930-d8fa410ff13a tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: created successfully
Sep 06 11:27:45.648021 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] cloning volumes/volume-2604484d-827d-44c0-bb71-0495236d04ec@snapshot-ce1f8161-c1df-4d63-8343-3ea1274e9e7d to volume-1485d56c-e273-4c3d-b6eb-a9e3bcbf6915 {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:27:45.648609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:45.709008 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:47.748150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:27:47.748859 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:27:47.753758 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:47.791356 ncdv-master-1 cinder-volume[133823]: WARNING cinder.volume.drivers.rbd [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError
Sep 06 11:27:48.233828 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0975cb8a-9f77-44a2-aab1-fb008ef5dead tempest-GroupSnapshotsTest-1911921834 None] Create group from source-snapshot-3c3043d7-13d9-4fd0-a2a2-7de0e42280cc completed successfully.
Sep 06 11:27:48.561614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:48.871752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:27:49.181870 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] deleting rbd volume volume-1485d56c-e273-4c3d-b6eb-a9e3bcbf6915 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:27:52.297396 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d req-b60da9e5-b665-4170-8459-01b0f356bd77 tempest-TestVolumeBackupRestore-739971810 None] Terminate volume connection completed successfully.
Sep 06 11:27:52.299202 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-2e8a7727-bdb9-4d4c-8b27-82f3cffabd2d req-b60da9e5-b665-4170-8459-01b0f356bd77 tempest-TestVolumeBackupRestore-739971810 None] Deleting attachment 0529e70c-bc24-490f-b50f-a9f5b65a7b08. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:27:54.133347 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['66a63da7-c24d-4766-abcb-d9d1b68d8578'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:27:54.153082 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-444664923 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-444664923, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:27:54.154035 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-444664923 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-444664923, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:27:54.248889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['6cb371bb-0378-47c3-afe4-f05dfbe22a17', '108b05c4-83d8-4a4d-a244-402dec81b0ad', 'f8064de8-004c-49fb-a411-9e9aa8313d31', '438e60af-82fc-4374-ba7f-e141cc51b9c1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:27:54.684016 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:54.713840 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:54.740953 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:27:54.752167 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-34c183ad-9d24-4196-8dc1-0f4ad6370932 tempest-GroupSnapshotsTest-1911921834 None] Delete group completed successfully.
Sep 06 11:27:55.003903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Acquiring lock "cinder-4f9029e9-670e-487d-b4bf-6eb74e504b25-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:27:55.015948 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-4f9029e9-670e-487d-b4bf-6eb74e504b25-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:27:55.221355 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:27:59.201005 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Volume volume-4f9029e9-670e-487d-b4bf-6eb74e504b25 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:00.192473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] deleting rbd volume volume-4f9029e9-670e-487d-b4bf-6eb74e504b25 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:00.196638 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:28:00.197224 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:00.224556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:00.281164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:00.291397 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: deleting
Sep 06 11:28:00.295159 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Acquiring lock "cinder-5a04c332-6403-4235-995c-5edab6e474c3-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:28:00.331222 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: deleting {{(pid=133823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Sep 06 11:28:00.335050 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-5a04c332-6403-4235-995c-5edab6e474c3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:28:00.359324 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:00.766626 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:04.541716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] deleting rbd volume volume-5a04c332-6403-4235-995c-5edab6e474c3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:08.689115 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=56,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:08.690465 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=64,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:08.808606 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-444664923 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-444664923, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:28:08.878648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['e0a401b3-8c18-4619-b65b-86beee6ffeda', '43850dd5-83a6-405e-945b-9f23f3189610', '0914e644-b0bc-491d-97b7-828ea0e2564a', 'ff04c103-daed-4060-b808-017bba47841a'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:09.261695 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-894187af-e959-4bbe-81ea-000294e62198 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 3c3043d7-13d9-4fd0-a2a2-7de0e42280cc: deleted successfully
Sep 06 11:28:10.789618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:11.313188 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:11.314062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-2604484d-827d-44c0-bb71-0495236d04ec is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:11.689220 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] deleting rbd volume volume-2604484d-827d-44c0-bb71-0495236d04ec {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:11.804401 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:11.826224 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (cdae5c0d-0526-45e7-b569-912ceec1b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:11.834382 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31adf3-9a29-4e2a-8d6d-4021252ad205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:11.863207 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31adf3-9a29-4e2a-8d6d-4021252ad205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455233108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=814c275c-3233-4ce6-b5b6-ce70b2c9cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6a64ebac2146b9a92c0ed0ac76a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:11Z,use_quota=True,user_id='5458eb197e36456fb7785c8625ed3140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:11.876530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdbc52d-e17e-484d-acf5-e5c5908e2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:11.881741 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdbc52d-e17e-484d-acf5-e5c5908e2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:11.887800 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008b00e-090a-454e-b61d-dee25bb7cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:11.891822 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008b00e-090a-454e-b61d-dee25bb7cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'volume_name': 'volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:11.900632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fdc5dd-b131-447e-8ce3-c13b2d717555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:11.904927 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fdc5dd-b131-447e-8ce3-c13b2d717555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:11.909969 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e60474-8b7a-46fd-a992-ab4e98e63b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:11.911091 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Volume 814c275c-3233-4ce6-b5b6-ce70b2c9cef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'volume_size': 1}
Sep 06 11:28:11.911480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] creating volume 'volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:11.912667 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:12.845734 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:12.847074 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:12.850578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e60474-8b7a-46fd-a992-ab4e98e63b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:12.855240 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b31158-26e5-4048-8fb3-71ea418e0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:12.925384 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6 (814c275c-3233-4ce6-b5b6-ce70b2c9cef6): created successfully
Sep 06 11:28:12.928922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b31158-26e5-4048-8fb3-71ea418e0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:12.939718 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Flow 'volume_create_manager' (cdae5c0d-0526-45e7-b569-912ceec1b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:13.084958 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-87f8b8c4-062f-4181-a367-53a8f22369d4 tempest-AttachVolumeNegativeTest-423464195 None] Created volume successfully.
Sep 06 11:28:13.440654 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:28:13.788699 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] deleting parent snapshot volume-5a04c332-6403-4235-995c-5edab6e474c3.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:28:17.407372 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 req-58ecc1fa-27a0-416a-a60f-1395597634b4 tempest-AttachVolumeNegativeTest-423464195 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:28:17.555622 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Created reservations ['0aea944f-4bd3-434e-919b-b1f7c4eca3a4', 'a468fc7c-415b-4a2c-b80a-440c4fd6947f', 'ef773d7b-93d4-4afc-a265-5d14f751d6e7', '4c58ee73-9f7d-4e84-935e-c3abccd39b09'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:17.668908 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Created reservations ['543ea115-1f2c-43d0-b3c8-d90d51a96e45', 'a7ff1db5-eb37-4993-8a46-e8472d3a8f9c', '41747aa2-3779-4ecf-820a-90eb2c7577fe', '1fd1639c-22fa-4bb9-afd4-bf101eee87d4'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:17.723148 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['78ff1a74-b293-40f2-baad-c7d4f86294f5'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:17.813946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:17.859484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:17.901849 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:17.914682 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Deleted volume successfully.
Sep 06 11:28:18.006312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:18.062827 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:18.095163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:18.098976 ncdv-master-1 cinder-volume[133823]: WARNING cinder.db.sqlalchemy.api [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-444664923']
Sep 06 11:28:18.105190 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Deleted volume successfully.
Sep 06 11:28:18.111920 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-48df17cc-1d66-4679-ad69-9206173c84c6 tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-5a04c332-6403-4235-995c-5edab6e474c3-delete_volume" released by "delete_volume" :: held 17.777s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:28:18.183958 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 req-58ecc1fa-27a0-416a-a60f-1395597634b4 tempest-AttachVolumeNegativeTest-423464195 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.777s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:28:18.184938 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 req-58ecc1fa-27a0-416a-a60f-1395597634b4 tempest-AttachVolumeNegativeTest-423464195 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:28:18.188576 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:INSERT=12,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:18.222267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['4f78b9a9-d239-49b3-b7b5-0bb69992109d', 'fdccc856-8acc-44dc-b0bd-2406b0ce3a98', '43f17a0c-ce26-4a7f-88db-e2f1868ed923', '160bd294-bd5d-4dc2-af2c-cf4977c6136d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:18.244952 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c454be79-e640-4e32-8d87-a2dfab53f44e tempest-TestVolumeBackupRestore-739971810 None] Lock "cinder-4f9029e9-670e-487d-b4bf-6eb74e504b25-delete_volume" released by "delete_volume" :: held 23.230s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:28:18.293798 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 req-58ecc1fa-27a0-416a-a60f-1395597634b4 tempest-AttachVolumeNegativeTest-423464195 None] Connection info returned from driver {'name': 'volumes/volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '814c275c-3233-4ce6-b5b6-ce70b2c9cef6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55d39d47-d886-4d6e-966e-54cff7338d40'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:28:18.434691 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=59,cinder:UPDATE=34,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:18.450645 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a92ed3df-1ecf-4a3d-9e7e-01758fddf198 req-58ecc1fa-27a0-416a-a60f-1395597634b4 tempest-AttachVolumeNegativeTest-423464195 None] attachment_update completed successfully.
Sep 06 11:28:18.745012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:18.786446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:18.837358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:18.841562 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-01c5cde2-0fc4-4fcb-8af2-060fb296c5e6 tempest-GroupSnapshotsTest-1911921834 None] Delete group completed successfully.
Sep 06 11:28:20.443968 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-82b43396-2004-4a41-b0ff-7d2e11b6681f tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-107910556: creating
Sep 06 11:28:20.752127 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-82b43396-2004-4a41-b0ff-7d2e11b6681f tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-107910556: created successfully
Sep 06 11:28:20.797930 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-82b43396-2004-4a41-b0ff-7d2e11b6681f tempest-GroupSnapshotsTest-1911921834 None] Create group completed successfully.
Sep 06 11:28:22.554280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:22.574779 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (00cee184-3738-43ee-afa2-baafec1cdd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:22.586534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34074535-e087-4de2-a83d-2dcde467fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:22.597955 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34074535-e087-4de2-a83d-2dcde467fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1203936234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59f5cb9f-3cb2-4c5c-aa03-f5a55b290e07,host='ncdv-master-1@ceph#ceph',id=e7d6c1fe-e525-4108-89e1-c9c75c7c9c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a54585a3c64c59a4a54488fa051d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:22Z,use_quota=True,user_id='0ec431fb2f40416f9c6c5fa2775634ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131d3fa9-43e5-4cdb-885d-ee53bdd455e7),volume_type_id=131d3fa9-43e5-4cdb-885d-ee53bdd455e7)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:22.603494 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61910d23-2374-4e95-abed-b9f7923c1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:22.607740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61910d23-2374-4e95-abed-b9f7923c1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:22.614089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4bb91d-7023-4b5b-8b44-989df6787199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:22.618770 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4bb91d-7023-4b5b-8b44-989df6787199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d6c1fe-e525-4108-89e1-c9c75c7c9c66', 'volume_name': 'volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:22.623558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23100f2-d31f-4c21-899c-ee7af41596ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:22.627444 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23100f2-d31f-4c21-899c-ee7af41596ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:22.632061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f35edc5-a6cf-48d9-90b3-c8af552aa877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:22.633436 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Volume e7d6c1fe-e525-4108-89e1-c9c75c7c9c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66', 'volume_size': 1}
Sep 06 11:28:22.634151 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] creating volume 'volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:22.634761 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:22.869608 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-47610b80-ffca-4d97-96ca-c7750d0df21c req-6237d6a3-a81c-4a2d-b3ab-244e82f62da1 tempest-AttachVolumeNegativeTest-423464195 None] Terminate volume connection completed successfully.
Sep 06 11:28:22.870108 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-47610b80-ffca-4d97-96ca-c7750d0df21c req-6237d6a3-a81c-4a2d-b3ab-244e82f62da1 tempest-AttachVolumeNegativeTest-423464195 None] Deleting attachment 55d39d47-d886-4d6e-966e-54cff7338d40. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:28:23.730321 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:23.730928 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:23.735090 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f35edc5-a6cf-48d9-90b3-c8af552aa877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:23.741312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e25f65-9352-46f2-b28e-bd9f0aca249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:23.912781 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66 (e7d6c1fe-e525-4108-89e1-c9c75c7c9c66): created successfully
Sep 06 11:28:23.919150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e25f65-9352-46f2-b28e-bd9f0aca249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:23.925561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (00cee184-3738-43ee-afa2-baafec1cdd47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:24.047598 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-471e17d1-db11-4628-be4b-245d188a1414 tempest-GroupSnapshotsTest-1911921834 None] Created volume successfully.
Sep 06 11:28:25.584744 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:25.623514 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (2185b191-bc3d-4021-8329-1da4e895f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:25.641420 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1a6ad0-01e0-4007-b830-2e3385ff37cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:25.668618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1a6ad0-01e0-4007-b830-2e3385ff37cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1747741618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59f5cb9f-3cb2-4c5c-aa03-f5a55b290e07,host='ncdv-master-1@ceph#ceph',id=95a63191-94dc-4b44-8953-940727916e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a54585a3c64c59a4a54488fa051d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:25Z,use_quota=True,user_id='0ec431fb2f40416f9c6c5fa2775634ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(131d3fa9-43e5-4cdb-885d-ee53bdd455e7),volume_type_id=131d3fa9-43e5-4cdb-885d-ee53bdd455e7)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:25.679446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23dca35-2088-471b-b4d3-2cbc6e428f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:25.695091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23dca35-2088-471b-b4d3-2cbc6e428f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:25.701861 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccacd663-97be-4230-8228-01bb481d464e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:25.709288 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccacd663-97be-4230-8228-01bb481d464e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a63191-94dc-4b44-8953-940727916e3a', 'volume_name': 'volume-95a63191-94dc-4b44-8953-940727916e3a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:25.716242 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54abb8d-d58c-4016-8c2c-652d30c5ee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:25.721199 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54abb8d-d58c-4016-8c2c-652d30c5ee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:25.727333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46b849-0932-417d-a12a-7c90de76fd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:25.730620 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Volume 95a63191-94dc-4b44-8953-940727916e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a63191-94dc-4b44-8953-940727916e3a', 'volume_size': 1}
Sep 06 11:28:25.731401 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] creating volume 'volume-95a63191-94dc-4b44-8953-940727916e3a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:25.732326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:26.459737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:26.460552 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:26.464781 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46b849-0932-417d-a12a-7c90de76fd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a63191-94dc-4b44-8953-940727916e3a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:26.471600 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3523a723-f432-40cf-a253-87a9ac5c6241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:26.565379 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-95a63191-94dc-4b44-8953-940727916e3a (95a63191-94dc-4b44-8953-940727916e3a): created successfully
Sep 06 11:28:26.571931 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3523a723-f432-40cf-a253-87a9ac5c6241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:26.585777 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (2185b191-bc3d-4021-8329-1da4e895f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:26.676102 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1b464028-34c4-449b-b833-ccdbff959349 tempest-GroupSnapshotsTest-1911921834 None] Created volume successfully.
Sep 06 11:28:27.938208 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a7710390-4158-4ae7-9d8f-d79798e1c45b tempest-GroupSnapshotsTest-1911921834 None] Update group completed successfully.
Sep 06 11:28:29.202675 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4ebdb8b6-d845-42a7-a57e-06c12b27f741 tempest-GroupSnapshotsTest-1911921834 None] Update group completed successfully.
Sep 06 11:28:29.523168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Acquiring lock "cinder-814c275c-3233-4ce6-b5b6-ce70b2c9cef6-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:28:29.556540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-814c275c-3233-4ce6-b5b6-ce70b2c9cef6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:28:29.685025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:29.848451 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:29.853193 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:30.054000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] deleting rbd volume volume-814c275c-3233-4ce6-b5b6-ce70b2c9cef6 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:30.550310 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b9a86b3e-0700-4876-a29d-7caf62cbad66 tempest-GroupSnapshotsTest-1911921834 None] Update group completed successfully.
Sep 06 11:28:31.741152 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dee6e051-8fd5-45b3-ad60-9c803ca5a559 tempest-GroupSnapshotsTest-1911921834 None] Update group completed successfully.
Sep 06 11:28:33.433344 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-631d2768-88e6-47eb-9d74-97848a734d4a tempest-GroupSnapshotsTest-1911921834 None] GroupSnapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: creating.
Sep 06 11:28:33.452764 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-631d2768-88e6-47eb-9d74-97848a734d4a tempest-GroupSnapshotsTest-1911921834 None] Group snapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: creating. {{(pid=133823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Sep 06 11:28:33.470970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-631d2768-88e6-47eb-9d74-97848a734d4a tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:33.876364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Created reservations ['e46dcad2-d137-4c43-98b9-a2603625fd51', '5255c4d9-21e5-49b6-b3b6-499bd4fb8d86', '7f79105a-3adf-45c5-978d-13162421b0c3', '38cc51f9-7781-432f-8501-03264260d995'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:34.031066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:34.058884 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:34.095719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:34.100295 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Deleted volume successfully.
Sep 06 11:28:34.179911 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-a95a5bbe-0179-4324-97a0-15567b961744 tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-814c275c-3233-4ce6-b5b6-ce70b2c9cef6-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:28:35.219616 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Acquiring lock "cinder-e7802977-f4fe-4eec-a9a4-6c7e555ce808-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:28:35.229165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-e7802977-f4fe-4eec-a9a4-6c7e555ce808-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:28:35.240920 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=73,cinder:UPDATE=25,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:35.416559 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:35.751076 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:35.751547 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:36.049270 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] deleting rbd volume volume-e7802977-f4fe-4eec-a9a4-6c7e555ce808 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:37.161639 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-631d2768-88e6-47eb-9d74-97848a734d4a tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:40.909141 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ab4a157f-de2c-4710-ad25-5f62a4cf08f3 tempest-GroupsTest-867038054 None] Group tempest-Group1-1589338396: creating
Sep 06 11:28:40.984517 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ab4a157f-de2c-4710-ad25-5f62a4cf08f3 tempest-GroupsTest-867038054 None] Group tempest-Group1-1589338396: created successfully
Sep 06 11:28:40.994635 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ab4a157f-de2c-4710-ad25-5f62a4cf08f3 tempest-GroupsTest-867038054 None] Create group completed successfully.
Sep 06 11:28:41.849121 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-631d2768-88e6-47eb-9d74-97848a734d4a tempest-GroupSnapshotsTest-1911921834 None] group_snapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: created successfully
Sep 06 11:28:41.870671 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Created reservations ['088e9ed2-74d5-4a94-a55b-1b3bf06f5776', '7bbfafcc-3435-4bfc-8278-f95b4b29cd48', '6c55a825-9734-46bd-a401-eaf30f3441c9', 'f2396d5c-c2ed-4590-8e8e-564151581ed3'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:42.040434 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=69,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:42.111261 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: deleting
Sep 06 11:28:42.133519 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: deleting {{(pid=133823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Sep 06 11:28:42.153256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:42.340466 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:42.363693 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:42.389304 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:42.400440 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Deleted volume successfully.
Sep 06 11:28:42.410659 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4aa79d69-e983-41a9-b37a-baaf63fce0bf tempest-GroupsTest-867038054 None] Group tempest-Group2-1171263647: creating
Sep 06 11:28:42.469296 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0af433c2-bcd7-4c1b-bbe9-c56200f76090 tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-e7802977-f4fe-4eec-a9a4-6c7e555ce808-delete_volume" released by "delete_volume" :: held 7.240s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:28:42.481474 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4aa79d69-e983-41a9-b37a-baaf63fce0bf tempest-GroupsTest-867038054 None] Group tempest-Group2-1171263647: created successfully
Sep 06 11:28:42.491284 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4aa79d69-e983-41a9-b37a-baaf63fce0bf tempest-GroupsTest-867038054 None] Create group completed successfully.
Sep 06 11:28:43.036849 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Acquiring lock "cinder-553c3814-3972-4737-be00-ff7beaefc711-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:28:43.046313 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-553c3814-3972-4737-be00-ff7beaefc711-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:28:43.199431 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:43.419934 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:43.420372 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Volume volume-553c3814-3972-4737-be00-ff7beaefc711 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:43.529309 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] deleting rbd volume volume-553c3814-3972-4737-be00-ff7beaefc711 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:44.243992 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:44.263206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (fa7fd614-e9d3-421a-a1dc-de33d7b9b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:44.270126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c273dd9-b41b-438a-bd56-d47ded5dd7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:44.289411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c273dd9-b41b-438a-bd56-d47ded5dd7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852962628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2a831bf-a992-4e62-9691-d2d8cedbf6ee,host='ncdv-master-1@ceph#ceph',id=3c83cb77-06b0-4197-babe-74738708c40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17c292a841d411a99a7a95db6140f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:44Z,use_quota=True,user_id='99d03b2c36c543ae8ded351fac0f8c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc828ad1-5eb1-450c-aa76-0b1dd32dd4b1),volume_type_id=bc828ad1-5eb1-450c-aa76-0b1dd32dd4b1)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:44.295680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00316e3-f298-45e1-aa1c-1dd5f8b0aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:44.299784 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00316e3-f298-45e1-aa1c-1dd5f8b0aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:44.304723 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfba2c67-c14e-4a98-8c5f-78e27f4d1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:44.308634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfba2c67-c14e-4a98-8c5f-78e27f4d1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c83cb77-06b0-4197-babe-74738708c40a', 'volume_name': 'volume-3c83cb77-06b0-4197-babe-74738708c40a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:44.313609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b8078-6223-4f96-8721-604ecc0b5a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:44.318046 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b8078-6223-4f96-8721-604ecc0b5a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:44.322638 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8952c0-9488-4cf9-991b-20bc233bc623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:44.323810 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Volume 3c83cb77-06b0-4197-babe-74738708c40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c83cb77-06b0-4197-babe-74738708c40a', 'volume_size': 1}
Sep 06 11:28:44.324189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] creating volume 'volume-3c83cb77-06b0-4197-babe-74738708c40a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:44.324945 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:45.422335 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:45.422997 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:45.426832 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8952c0-9488-4cf9-991b-20bc233bc623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c83cb77-06b0-4197-babe-74738708c40a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:45.431293 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5767f934-b8b9-42c9-a585-9b762f2d6de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:45.488562 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Volume volume-3c83cb77-06b0-4197-babe-74738708c40a (3c83cb77-06b0-4197-babe-74738708c40a): created successfully
Sep 06 11:28:45.492288 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5767f934-b8b9-42c9-a585-9b762f2d6de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:45.499489 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (fa7fd614-e9d3-421a-a1dc-de33d7b9b32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:45.551646 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9e7f9928-49c7-4abe-901d-09078d1719b6 tempest-GroupsTest-867038054 None] Created volume successfully.
Sep 06 11:28:45.934135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:46.882109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:47.082867 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:47.083332 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Volume volume-3c83cb77-06b0-4197-babe-74738708c40a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:47.557892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] deleting rbd volume volume-3c83cb77-06b0-4197-babe-74738708c40a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:50.121968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Created reservations ['fb09cdf7-cac0-4ee7-9aa9-91322b2a0eca', '8cc3e73d-8e1c-4672-8030-9c8443b49593', 'bef35e77-cd78-4bdf-afa2-ea07c62d9f30', 'cb469a8f-a5fb-4147-9ff6-0b3a1d307d75'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:50.276736 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:50.301183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:50.330127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:50.339962 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Deleted volume successfully.
Sep 06 11:28:50.509846 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-418f4428-d9fb-4eb4-b3dc-a3bf25481aca tempest-AttachVolumeNegativeTest-423464195 None] Lock "cinder-553c3814-3972-4737-be00-ff7beaefc711-delete_volume" released by "delete_volume" :: held 7.464s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:28:50.554454 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1493594347 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1493594347, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:28:50.554454 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1493594347 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1493594347, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:28:50.557685 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=71,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:50.643726 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['4117578c-cc4f-4d02-9eb5-ccf8d441adfe', '9d793b44-a3ad-4581-a2af-38bf79e24f6c', 'dcb428e4-45e4-4276-bbe1-0436a63c505b', '6dd02094-5338-413e-8a96-75010c4e8055'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:50.945905 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['a57fb978-cb8a-4d27-8409-b91793ec63bd', 'f7b3a726-f6c2-4281-9843-37d50ef5e86d', '01011200-7b0e-4533-ae03-221262504bc9', '6517f8e3-26b9-4845-9bdc-a0f2ca1bc0f8'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:51.070175 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=53,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=10 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:28:51.234179 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-97069d0e-55b4-43f8-b77c-f36f735541a8 tempest-GroupSnapshotsTest-1911921834 None] group_snapshot c0620bf9-04d4-4da1-91d5-2549b75e6373: deleted successfully
Sep 06 11:28:52.180385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:52.469193 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:52.469853 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-95a63191-94dc-4b44-8953-940727916e3a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:52.631970 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] deleting rbd volume volume-95a63191-94dc-4b44-8953-940727916e3a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:52.974407 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Created reservations ['6ac8638f-1076-40a1-abdb-22da6d8bf20e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:52.995272 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-832538957 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-832538957, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:28:52.996218 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-832538957 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-832538957, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:28:53.107332 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Created reservations ['a189e3b2-c77a-4282-8e88-3bd96966b6bc', '16b34488-84b4-4f65-87c1-53e70718d089', 'a51ed732-afbf-42e5-b22d-a4b86d18033e', '7d67feb8-1f7e-4bc6-b9c6-24617dc215b3'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:53.607813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:53.633539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:53.658043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:53.663609 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-52948559-b394-4f8e-91e2-d31869b1ef58 tempest-GroupsTest-867038054 None] Delete group completed successfully.
Sep 06 11:28:54.774559 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-982cb152-b285-43f5-ad53-a5a0b38a274b tempest-GroupsTest-867038054 None] Created reservations ['c7b53304-7554-4070-8b90-9e919d7c2bd9'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:28:54.943360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-982cb152-b285-43f5-ad53-a5a0b38a274b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:54.965629 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-982cb152-b285-43f5-ad53-a5a0b38a274b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:54.990261 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-982cb152-b285-43f5-ad53-a5a0b38a274b tempest-GroupsTest-867038054 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:28:54.994280 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-982cb152-b285-43f5-ad53-a5a0b38a274b tempest-GroupsTest-867038054 None] Delete group completed successfully.
Sep 06 11:28:56.798127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:56.950958 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:28:56.951737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:28:57.104892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] deleting rbd volume volume-e7d6c1fe-e525-4108-89e1-c9c75c7c9c66 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:28:57.120636 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-837f2ca8-140e-4329-b49e-02056a9b3aaa tempest-GroupsTest-867038054 None] Group tempest-GroupsTest-Group-1437774892: creating
Sep 06 11:28:57.225235 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-837f2ca8-140e-4329-b49e-02056a9b3aaa tempest-GroupsTest-867038054 None] Group tempest-GroupsTest-Group-1437774892: created successfully
Sep 06 11:28:57.234165 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-837f2ca8-140e-4329-b49e-02056a9b3aaa tempest-GroupsTest-867038054 None] Create group completed successfully.
Sep 06 11:28:57.908055 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:57.930481 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Flow 'volume_create_manager' (98a1574e-1148-4e3c-8d67-9e020eecf3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:57.937485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b532b39-85cf-47eb-b4d3-eff15836916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:57.953392 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b532b39-85cf-47eb-b4d3-eff15836916d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1347928193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b54a911f-e276-4a81-b4b7-cbdafe431637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e35bc5bedd4f1b95313973f8118470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:58Z,use_quota=True,user_id='c3ea9be43d92471584942594b3febc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:57.958682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3dcdc5-1b8b-4356-a36c-4e12e969bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:57.962711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3dcdc5-1b8b-4356-a36c-4e12e969bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:57.967691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e8ec97-6c5d-43f6-abd4-049e26a1f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:57.974753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e8ec97-6c5d-43f6-abd4-049e26a1f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54a911f-e276-4a81-b4b7-cbdafe431637', 'volume_name': 'volume-b54a911f-e276-4a81-b4b7-cbdafe431637', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:57.976968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad7e8b2-5818-45cd-92c0-8e57e64772e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:57.980733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad7e8b2-5818-45cd-92c0-8e57e64772e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:57.985270 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88992f2b-9ee4-49ab-8db6-76becf68534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:57.986897 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Volume b54a911f-e276-4a81-b4b7-cbdafe431637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54a911f-e276-4a81-b4b7-cbdafe431637', 'volume_size': 1}
Sep 06 11:28:57.987317 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] creating volume 'volume-b54a911f-e276-4a81-b4b7-cbdafe431637' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:57.988067 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:58.781198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:28:58.799900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (3314096f-9462-45a7-941b-542d941a7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:58.806180 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89f42f7-450f-4669-8510-27402bced580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.824306 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89f42f7-450f-4669-8510-27402bced580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1106030994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2d44149c-7fdd-456b-ad72-0a7c1923d692,host='ncdv-master-1@ceph#ceph',id=9e910007-6641-4a73-983d-bbd1ab319e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17c292a841d411a99a7a95db6140f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:28:59Z,use_quota=True,user_id='99d03b2c36c543ae8ded351fac0f8c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4be65c-71b9-4972-9a7d-f57e9df84d73),volume_type_id=ca4be65c-71b9-4972-9a7d-f57e9df84d73)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:58.829426 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4ab09f-aa48-4302-9732-a3edbf2d6294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.834036 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4ab09f-aa48-4302-9732-a3edbf2d6294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:58.839404 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594e160f-0c9e-472d-ad20-5c80f31b5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.843411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594e160f-0c9e-472d-ad20-5c80f31b5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e910007-6641-4a73-983d-bbd1ab319e9f', 'volume_name': 'volume-9e910007-6641-4a73-983d-bbd1ab319e9f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:58.848251 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd54bc4f-0f0a-42d4-b798-778542117ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.852040 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd54bc4f-0f0a-42d4-b798-778542117ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:58.856609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8626b6-e803-4cab-a32e-9c2ee9f4d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.857685 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Volume 9e910007-6641-4a73-983d-bbd1ab319e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e910007-6641-4a73-983d-bbd1ab319e9f', 'volume_size': 1}
Sep 06 11:28:58.858079 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] creating volume 'volume-9e910007-6641-4a73-983d-bbd1ab319e9f' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:28:58.858719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:28:58.912275 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:58.912947 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:58.917252 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88992f2b-9ee4-49ab-8db6-76becf68534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54a911f-e276-4a81-b4b7-cbdafe431637', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:58.921750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbeb4cb-2cc5-4020-8a2c-7a9b2856acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:58.991235 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Volume volume-b54a911f-e276-4a81-b4b7-cbdafe431637 (b54a911f-e276-4a81-b4b7-cbdafe431637): created successfully
Sep 06 11:28:58.994735 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbeb4cb-2cc5-4020-8a2c-7a9b2856acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:59.000111 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Flow 'volume_create_manager' (98a1574e-1148-4e3c-8d67-9e020eecf3bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:59.063937 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-ab340b86-4a20-4f49-9c11-aae0206a9b94 req-992369a9-31e4-4b9e-b37e-c603bbfc6a4e tempest-VolumesSnapshotsTestJSON-1899004621 None] Created volume successfully.
Sep 06 11:28:59.685695 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:28:59.686071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:28:59.689794 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8626b6-e803-4cab-a32e-9c2ee9f4d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e910007-6641-4a73-983d-bbd1ab319e9f', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:59.694482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77dda5-8928-411e-8af9-cbf8f1d67a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:28:59.805591 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Volume volume-9e910007-6641-4a73-983d-bbd1ab319e9f (9e910007-6641-4a73-983d-bbd1ab319e9f): created successfully
Sep 06 11:28:59.809881 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77dda5-8928-411e-8af9-cbf8f1d67a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:28:59.815999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (3314096f-9462-45a7-941b-542d941a7283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:28:59.910340 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fc569141-60da-431c-8f88-5d82839b847f tempest-GroupsTest-867038054 None] Created volume successfully.
Sep 06 11:29:00.197804 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:29:00.198467 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:00.221339 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:00.371547 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:00.605365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-1c506290-71d9-40eb-b317-5d0d120511aa req-d3e6b8a2-c358-4bd4-9c88-27be77b92c58 tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:01.673377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:29:01.692539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (1272d9af-569c-4270-bef1-ee98f63a0644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:01.698765 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5180d53-6f1f-44e9-905f-c15493e2ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:01.715370 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5180d53-6f1f-44e9-905f-c15493e2ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1463247027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2d44149c-7fdd-456b-ad72-0a7c1923d692,host='ncdv-master-1@ceph#ceph',id=d6952772-635a-41d0-ab68-b88bce166fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17c292a841d411a99a7a95db6140f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:29:01Z,use_quota=True,user_id='99d03b2c36c543ae8ded351fac0f8c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4be65c-71b9-4972-9a7d-f57e9df84d73),volume_type_id=ca4be65c-71b9-4972-9a7d-f57e9df84d73)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:01.720611 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53110766-5af5-4adf-b08a-76e1775e94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:01.724618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53110766-5af5-4adf-b08a-76e1775e94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:01.729541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b384a0e-b20f-4cc3-a7a2-8b188d30e456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:01.733500 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b384a0e-b20f-4cc3-a7a2-8b188d30e456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6952772-635a-41d0-ab68-b88bce166fe6', 'volume_name': 'volume-d6952772-635a-41d0-ab68-b88bce166fe6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:01.738225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8fc63d-5eeb-46c9-b7da-a4b793d565f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:01.742012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8fc63d-5eeb-46c9-b7da-a4b793d565f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:01.746601 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef300d7e-0760-49bf-80e9-371804456245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:01.747721 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Volume d6952772-635a-41d0-ab68-b88bce166fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6952772-635a-41d0-ab68-b88bce166fe6', 'volume_size': 1}
Sep 06 11:29:01.748115 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] creating volume 'volume-d6952772-635a-41d0-ab68-b88bce166fe6' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:29:01.748751 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:02.511203 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['e1f6db50-daa8-4757-8315-e1204418d859'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:02.530899 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1493594347 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1493594347, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:02.619872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['c25103b3-7857-49dc-a727-aa2a09b1feb2', '109dd6b9-a131-4d8c-bf31-0415357358e2', '82c08cd4-c82c-408e-973a-6e02774f1e90', 'a9e73c33-ab52-4844-87b6-3e3c4ea5cf30'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:02.777959 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:02.791552 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:02.851427 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:29:02.851812 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:29:02.855728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef300d7e-0760-49bf-80e9-371804456245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6952772-635a-41d0-ab68-b88bce166fe6', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:02.860237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b01426-5147-4b1f-8b28-f039ce8f3888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:02.986710 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Volume volume-d6952772-635a-41d0-ab68-b88bce166fe6 (d6952772-635a-41d0-ab68-b88bce166fe6): created successfully
Sep 06 11:29:02.990305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b01426-5147-4b1f-8b28-f039ce8f3888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:02.995972 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Flow 'volume_create_manager' (1272d9af-569c-4270-bef1-ee98f63a0644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:02.999642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['62788a07-a421-44b0-8b45-fea5cabdd1ce', '09353157-5d06-4da1-bcfe-15b762cb8ef7', '17c6a9d6-44fc-4032-9f1a-bee4761e24d5', '0f958883-47a3-4379-afff-dba194e523aa'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:03.152329 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dc105921-7878-491b-9951-cacb6fd98ef2 tempest-GroupsTest-867038054 None] Created volume successfully.
Sep 06 11:29:03.452801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:03.477978 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:03.502179 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:03.506661 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-1c506290-71d9-40eb-b317-5d0d120511aa req-d3e6b8a2-c358-4bd4-9c88-27be77b92c58 tempest-VolumesSnapshotsTestJSON-1899004621 None] Create snapshot completed successfully
Sep 06 11:29:03.509747 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aecd5824-c5cf-421a-b7bd-73fe117d6580 tempest-GroupSnapshotsTest-1911921834 None] Delete group completed successfully.
Sep 06 11:29:03.885800 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] Acquiring lock "cinder-5ef5ae08-81d8-4c21-9f17-3693039cc2bd-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:29:03.896938 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] Lock "cinder-5ef5ae08-81d8-4c21-9f17-3693039cc2bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:29:03.898632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:04.078202 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-50b6985e-14a1-4142-af22-8aacf4bea8a7 tempest-GroupsTest-867038054 None] Update group completed successfully.
Sep 06 11:29:05.029973 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c8cfa9c9-051a-4b9a-af39-e714f96b04cc tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-7988259: creating
Sep 06 11:29:05.238741 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c8cfa9c9-051a-4b9a-af39-e714f96b04cc tempest-GroupSnapshotsTest-1911921834 None] Group tempest-GroupSnapshotsTest-Group-7988259: created successfully
Sep 06 11:29:05.257103 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c8cfa9c9-051a-4b9a-af39-e714f96b04cc tempest-GroupSnapshotsTest-1911921834 None] Create group completed successfully.
Sep 06 11:29:07.510719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] Created reservations ['c59c945b-42c8-41a6-8fa0-db7d5e33bac7', '90a6f906-c27a-4b97-a0a8-73d18d2b4d4a', '059234f8-7336-495e-beae-76eb65484101', 'b45ac073-cb9a-4114-afe4-ff1720631ed4'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:07.578423 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e3a578e9-3164-4223-941c-4bdf65e8af53 tempest-GroupsTest-867038054 None] Update group completed successfully.
Sep 06 11:29:07.718298 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] Delete snapshot completed successfully.
Sep 06 11:29:07.729210 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-78a46b28-82df-42bd-913d-7c3ac24cac5c req-7cb72295-8627-4bdc-9865-05bc74a81001 tempest-VolumesSnapshotsTestJSON-1899004621 None] Lock "cinder-5ef5ae08-81d8-4c21-9f17-3693039cc2bd-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:29:08.397372 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:29:08.420217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (73e4e5f9-688a-42f2-954b-34c9f7f7bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:08.421015 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46d8171-d24a-40df-9f8b-1bbb71f7096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:08.438113 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Acquiring lock "cinder-b54a911f-e276-4a81-b4b7-cbdafe431637-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:29:08.457529 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46d8171-d24a-40df-9f8b-1bbb71f7096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1665312017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0e2f87dc-7ea3-4e3c-94aa-dd73bd6882da,host='ncdv-master-1@ceph#ceph',id=52d28b5a-1f41-4b21-a802-451f933063a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a54585a3c64c59a4a54488fa051d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:29:08Z,use_quota=True,user_id='0ec431fb2f40416f9c6c5fa2775634ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07933507-e2b2-4f7c-b7ab-eb0955e19973),volume_type_id=07933507-e2b2-4f7c-b7ab-eb0955e19973)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:08.470183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8a71a1-b33f-4d32-89aa-0a1a75f312b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:08.473746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8a71a1-b33f-4d32-89aa-0a1a75f312b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:08.479266 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7204cc1c-e6fb-4882-9efa-52a23de966d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:08.489386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7204cc1c-e6fb-4882-9efa-52a23de966d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d28b5a-1f41-4b21-a802-451f933063a7', 'volume_name': 'volume-52d28b5a-1f41-4b21-a802-451f933063a7', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:08.495724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69cb071-07d8-40a2-abc5-bd785bb105c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:08.501832 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69cb071-07d8-40a2-abc5-bd785bb105c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:08.508322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1a92a1-2de1-4f7b-8c57-80fb88f72ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:08.509576 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Volume 52d28b5a-1f41-4b21-a802-451f933063a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d28b5a-1f41-4b21-a802-451f933063a7', 'volume_size': 1}
Sep 06 11:29:08.509979 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] creating volume 'volume-52d28b5a-1f41-4b21-a802-451f933063a7' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:29:08.510972 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:08.544377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Lock "cinder-b54a911f-e276-4a81-b4b7-cbdafe431637-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:29:08.675134 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:08.968725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:08.969158 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Volume volume-b54a911f-e276-4a81-b4b7-cbdafe431637 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:09.146267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] deleting rbd volume volume-b54a911f-e276-4a81-b4b7-cbdafe431637 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:09.187165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:09.437132 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:09.437889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Volume volume-9e910007-6641-4a73-983d-bbd1ab319e9f is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:09.752567 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] deleting rbd volume volume-9e910007-6641-4a73-983d-bbd1ab319e9f {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:09.758997 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:29:09.759412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:29:09.763214 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1a92a1-2de1-4f7b-8c57-80fb88f72ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d28b5a-1f41-4b21-a802-451f933063a7', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:09.796486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9bfeba-e3c4-4579-a269-317b6aa41a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:09.864284 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Volume volume-52d28b5a-1f41-4b21-a802-451f933063a7 (52d28b5a-1f41-4b21-a802-451f933063a7): created successfully
Sep 06 11:29:09.868000 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9bfeba-e3c4-4579-a269-317b6aa41a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:09.873330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Flow 'volume_create_manager' (73e4e5f9-688a-42f2-954b-34c9f7f7bc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:09.944817 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-891ec25a-9f25-4e95-b047-837172650a51 tempest-GroupSnapshotsTest-1911921834 None] Created volume successfully.
Sep 06 11:29:10.842223 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-79f576a0-ccbc-4f79-8a1f-594dec93fe1e tempest-GroupSnapshotsTest-1911921834 None] GroupSnapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: creating.
Sep 06 11:29:10.860750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-79f576a0-ccbc-4f79-8a1f-594dec93fe1e tempest-GroupSnapshotsTest-1911921834 None] Group snapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: creating. {{(pid=133823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Sep 06 11:29:10.868142 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:INSERT=6,cinder:SELECT=59,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:10.886480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79f576a0-ccbc-4f79-8a1f-594dec93fe1e tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:14.478339 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-79f576a0-ccbc-4f79-8a1f-594dec93fe1e tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: created successfully
Sep 06 11:29:15.300582 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: deleting
Sep 06 11:29:15.318046 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: deleting {{(pid=133823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Sep 06 11:29:15.336381 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:16.746040 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Created reservations ['371b9c60-4e9d-4e95-9a36-386c2fa41c41', '2b9cabbc-9617-47ff-8388-ab96b8d12573', '6b37a987-61d9-46e3-9790-d31fd5a93ee1', 'e50c23b6-80af-4c6a-8168-d59e8e60fe1c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:17.009383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:17.048589 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:17.101816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:17.110118 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:17.431850 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:17.432360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Volume volume-d6952772-635a-41d0-ab68-b88bce166fe6 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:17.563633 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] deleting rbd volume volume-d6952772-635a-41d0-ab68-b88bce166fe6 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:17.570667 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Deleted volume successfully.
Sep 06 11:29:17.705023 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-8d0bd3c7-b5b7-4f91-9bee-6872d6038047 req-1e171684-77d9-4407-9439-091b17003cc6 tempest-VolumesSnapshotsTestJSON-1899004621 None] Lock "cinder-b54a911f-e276-4a81-b4b7-cbdafe431637-delete_volume" released by "delete_volume" :: held 9.123s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:29:19.139037 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-474557845 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-474557845, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:19.139885 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-474557845 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-474557845, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:19.292923 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['6b4af499-9e65-4d38-93e9-8e82feb7dd2a', '7b7fb0ed-0e7f-4702-b74c-b8104e648cea', 'aee414f7-6e60-464c-a18b-a56248b77f64', '15be1da8-1349-4177-8cfa-03cefe70f8f7'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:19.409600 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:19.660679 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-16cc624f-7240-47c9-966a-1cf76d4aef1f tempest-GroupSnapshotsTest-1911921834 None] group_snapshot 047f5d6b-22ad-4ee1-8f17-837182ae168a: deleted successfully
Sep 06 11:29:20.256604 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:20.442543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:20.443055 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Volume volume-52d28b5a-1f41-4b21-a802-451f933063a7 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:20.702347 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] deleting rbd volume volume-52d28b5a-1f41-4b21-a802-451f933063a7 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:24.785779 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Created reservations ['42787d8c-2ff3-4867-a3d5-67062b9ad1d1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:24.806614 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1621759569 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1621759569, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:24.807474 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1621759569 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1621759569, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:24.932740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Created reservations ['e45ff4a4-f7bb-4e5f-abce-04db442670ad', '3b21e4b0-2cbb-45ae-8dd9-864347a45372', '9897cae0-4213-46e8-b394-499200650f00', '95d640f4-78db-426e-84f7-8fc46c3b2fe6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:25.311459 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Created reservations ['27068296-cece-4148-b133-605658d0288a', '2f3b5b81-22fe-4f4a-bbde-036b9b588784', '6358a879-6112-4048-9719-c9042e5739da', '604fec5f-b77a-4459-92f9-9e3acb8e2c75'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:25.415888 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=58,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:25.728900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:25.891975 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:25.931752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:25.937622 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c6f78795-5e1e-4d20-8de1-f9df028cea3b tempest-GroupsTest-867038054 None] Delete group completed successfully.
Sep 06 11:29:27.048808 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['eca0e872-2c77-44e7-a1fb-7f3a021c7fe2'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:27.074389 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-474557845 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-474557845, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:27.152854 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Created reservations ['f9c1a9c6-f51a-44fc-b064-cf637d61deb7', 'a69ae678-c685-48bf-a4e3-71032288cbde', '91ec6044-18f9-4480-823c-22ae2cf640bf', '230f0f24-cc10-49aa-8e76-7e9b05f68d4c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:27.699305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:27.723672 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:27.757413 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:27.761987 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3c866c2f-3ba3-4b55-841e-7b71f855667c tempest-GroupSnapshotsTest-1911921834 None] Delete group completed successfully.
Sep 06 11:29:33.234322 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2e575927-29f5-48b4-90af-2c3fd2682a05 tempest-GroupsV320Test-1406742145 None] Group tempest-GroupsV320Test-Group-480225774: creating
Sep 06 11:29:33.339619 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2e575927-29f5-48b4-90af-2c3fd2682a05 tempest-GroupsV320Test-1406742145 None] Group tempest-GroupsV320Test-Group-480225774: created successfully
Sep 06 11:29:33.351243 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2e575927-29f5-48b4-90af-2c3fd2682a05 tempest-GroupsV320Test-1406742145 None] Create group completed successfully.
Sep 06 11:29:35.099903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-d786c284-2b02-4834-ab00-0b38d19cfa22 tempest-GroupsV320Test-1406742145 None] Created reservations ['bba5f511-c0a7-4812-8004-84bf30e74a4c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:35.107133 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:INSERT=9,cinder:UPDATE=34 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:35.294749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:29:35.323733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Flow 'volume_create_manager' (3a4e9340-7ac7-4b1c-b0a8-d887b1ef5283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:35.333094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599dffb6-d93b-4e6c-9e1d-a54ffaf4f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:35.353835 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d786c284-2b02-4834-ab00-0b38d19cfa22 tempest-GroupsV320Test-1406742145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:35.377783 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d786c284-2b02-4834-ab00-0b38d19cfa22 tempest-GroupsV320Test-1406742145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:35.404768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-d786c284-2b02-4834-ab00-0b38d19cfa22 tempest-GroupsV320Test-1406742145 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:35.411516 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599dffb6-d93b-4e6c-9e1d-a54ffaf4f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1656744951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c211b39-4915-4e33-9248-c164a242e30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2258f4a93649f898bad7d90e5efb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:29:35Z,use_quota=True,user_id='d17d79b38c4c48e7b253617177cf5000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:35.416795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a42c2e-74c4-4483-9192-55be5ba9dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:35.420892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a42c2e-74c4-4483-9192-55be5ba9dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:35.425835 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5ceb4f-f773-4477-9c75-071a1cfe59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:35.430009 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5ceb4f-f773-4477-9c75-071a1cfe59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c211b39-4915-4e33-9248-c164a242e30e', 'volume_name': 'volume-3c211b39-4915-4e33-9248-c164a242e30e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:35.436878 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecff524-552a-4527-a66f-418025a35b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:35.439328 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecff524-552a-4527-a66f-418025a35b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:35.444913 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f8307-6712-477b-97b4-40ba60aaa58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:35.446014 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Volume 3c211b39-4915-4e33-9248-c164a242e30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c211b39-4915-4e33-9248-c164a242e30e', 'volume_size': 1}
Sep 06 11:29:35.446410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] creating volume 'volume-3c211b39-4915-4e33-9248-c164a242e30e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:29:35.447198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:35.522904 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d786c284-2b02-4834-ab00-0b38d19cfa22 tempest-GroupsV320Test-1406742145 None] Delete group completed successfully.
Sep 06 11:29:36.098095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:29:36.098477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:29:36.102146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f8307-6712-477b-97b4-40ba60aaa58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c211b39-4915-4e33-9248-c164a242e30e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:36.106589 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01121f4-af55-418d-a449-fa1b20a4a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:36.207302 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Volume volume-3c211b39-4915-4e33-9248-c164a242e30e (3c211b39-4915-4e33-9248-c164a242e30e): created successfully
Sep 06 11:29:36.211882 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01121f4-af55-418d-a449-fa1b20a4a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:36.217398 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Flow 'volume_create_manager' (3a4e9340-7ac7-4b1c-b0a8-d887b1ef5283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:36.301111 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-16bad372-9f67-4f55-85b8-60c989930aaf tempest-VolumesServicesTestJSON-352361390 None] Created volume successfully.
Sep 06 11:29:37.423841 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Acquiring lock "cinder-3c211b39-4915-4e33-9248-c164a242e30e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:29:37.443091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Lock "cinder-3c211b39-4915-4e33-9248-c164a242e30e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:29:37.535603 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:37.733763 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:37.734196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Volume volume-3c211b39-4915-4e33-9248-c164a242e30e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:37.894641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] deleting rbd volume volume-3c211b39-4915-4e33-9248-c164a242e30e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:41.717050 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Created reservations ['0646ba03-e24f-45b5-a403-1a870c8bd253', 'aeeb98d5-08fb-4cea-af87-85dc095b55b5', '88c58a4d-8f47-4301-82b8-933ef3e14ac6', '9fb474ac-6f86-4bf6-9b8c-8ef8cd6a38c5'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:42.026334 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:42.065254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:42.115471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:42.120633 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Deleted volume successfully.
Sep 06 11:29:42.221029 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-906fda25-6c36-4593-a79b-34cb6789e92a tempest-VolumesServicesTestJSON-352361390 None] Lock "cinder-3c211b39-4915-4e33-9248-c164a242e30e-delete_volume" released by "delete_volume" :: held 4.782s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:29:43.249629 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:29:43.269524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Flow 'volume_create_manager' (d17aa05d-96b9-48c6-8865-d609819e853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:43.277966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e16ecd-1f68-449e-ab25-0add291914a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:43.295480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e16ecd-1f68-449e-ab25-0add291914a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-116310206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d66d9a89-502c-4b22-b792-e7b57cad5415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a17919cdeb79404090e5fc5701e51fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:29:43Z,use_quota=True,user_id='7ab1b28b2abf4581a4d92f501cf71545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fd2a68e-a8a9-4af8-8eec-0e551e2dd94d),volume_type_id=5fd2a68e-a8a9-4af8-8eec-0e551e2dd94d)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:43.300845 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbe612a-67b2-4366-9979-a2aa2569625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:43.304975 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbe612a-67b2-4366-9979-a2aa2569625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:43.309977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664d4589-a79e-4bd8-be2f-1613827a01ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:43.314294 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664d4589-a79e-4bd8-be2f-1613827a01ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66d9a89-502c-4b22-b792-e7b57cad5415', 'volume_name': 'volume-d66d9a89-502c-4b22-b792-e7b57cad5415', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:43.320377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c833fe-3be2-4db3-a3bb-3d6ad2680d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:43.324691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c833fe-3be2-4db3-a3bb-3d6ad2680d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:43.330340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f697db-7121-48f7-baf6-0f1457518ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:43.331473 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Volume d66d9a89-502c-4b22-b792-e7b57cad5415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66d9a89-502c-4b22-b792-e7b57cad5415', 'volume_size': 1}
Sep 06 11:29:43.331875 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] creating volume 'volume-d66d9a89-502c-4b22-b792-e7b57cad5415' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:29:43.333227 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:44.371766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:29:44.372870 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:29:44.383954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f697db-7121-48f7-baf6-0f1457518ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66d9a89-502c-4b22-b792-e7b57cad5415', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:44.402026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39b1222-8fec-4256-a0f4-b386d43cf2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:44.470112 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Volume volume-d66d9a89-502c-4b22-b792-e7b57cad5415 (d66d9a89-502c-4b22-b792-e7b57cad5415): created successfully
Sep 06 11:29:44.474641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39b1222-8fec-4256-a0f4-b386d43cf2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:44.487146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Flow 'volume_create_manager' (d17aa05d-96b9-48c6-8865-d609819e853b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:44.574218 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f7639887-a215-4013-ae9c-61d9603faeee tempest-VolumeTypesAccessTest-178326344 None] Created volume successfully.
Sep 06 11:29:46.349237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Acquiring lock "cinder-d66d9a89-502c-4b22-b792-e7b57cad5415-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:29:46.360872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Lock "cinder-d66d9a89-502c-4b22-b792-e7b57cad5415-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:29:46.468543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:46.654099 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:46.654538 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Volume volume-d66d9a89-502c-4b22-b792-e7b57cad5415 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:46.809068 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] deleting rbd volume volume-d66d9a89-502c-4b22-b792-e7b57cad5415 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:29:50.630458 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2093848336 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2093848336, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:50.631431 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2093848336 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2093848336, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:29:50.651251 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:29:50.734480 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Created reservations ['6753cd6f-8014-4108-ab46-f6f216abd2bf', 'b22fb04b-58ba-4ab9-8493-851a3f1a0c3e', 'fb7cc37c-84ef-4467-b509-09f854c915f9', '6da9bc96-a6f9-4ae9-bd98-6bf2b889fbbf'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:29:50.969048 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:51.001515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:51.033350 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:29:51.037908 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Deleted volume successfully.
Sep 06 11:29:51.109972 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-425ee82e-6701-407d-99a8-15ac3fc03593 tempest-VolumeTypesAccessTest-178326344 None] Lock "cinder-d66d9a89-502c-4b22-b792-e7b57cad5415-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:29:54.261546 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:29:54.303335 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Flow 'volume_create_manager' (0f74a5ad-b28b-4d26-87f0-0a40e385b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:54.317474 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a87fa-19c9-44e1-a63c-2bf4458b3797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:54.345639 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a87fa-19c9-44e1-a63c-2bf4458b3797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-106614579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7edd06af-2e8a-46fc-9446-35740d4e2074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10efbb65a176403d93859c5bf2671e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:29:54Z,use_quota=True,user_id='d0f76cd4cdaa45d3899981b9cc1c4f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:54.351537 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb2baf-f7a9-4c7e-ad54-289bae2705cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:54.356329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb2baf-f7a9-4c7e-ad54-289bae2705cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:54.362510 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b450818-b0a0-43ea-ae65-915e2abd5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:54.367312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b450818-b0a0-43ea-ae65-915e2abd5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edd06af-2e8a-46fc-9446-35740d4e2074', 'volume_name': 'volume-7edd06af-2e8a-46fc-9446-35740d4e2074', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:54.372271 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ee2ee3-7504-4b82-a1cf-73d45b4f5427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:54.377113 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ee2ee3-7504-4b82-a1cf-73d45b4f5427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:54.381485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50bcb5f-b7e3-44c3-89d1-a18013af2dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:54.382607 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Volume 7edd06af-2e8a-46fc-9446-35740d4e2074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edd06af-2e8a-46fc-9446-35740d4e2074', 'volume_size': 1}
Sep 06 11:29:54.383057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] creating volume 'volume-7edd06af-2e8a-46fc-9446-35740d4e2074' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:29:54.384077 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:55.166581 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:29:55.167168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:29:55.171183 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50bcb5f-b7e3-44c3-89d1-a18013af2dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edd06af-2e8a-46fc-9446-35740d4e2074', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:55.176065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2db0fd5-87f9-4601-9fdb-f3b996b16d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:29:55.248425 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Volume volume-7edd06af-2e8a-46fc-9446-35740d4e2074 (7edd06af-2e8a-46fc-9446-35740d4e2074): created successfully
Sep 06 11:29:55.252618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2db0fd5-87f9-4601-9fdb-f3b996b16d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:29:55.258702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Flow 'volume_create_manager' (0f74a5ad-b28b-4d26-87f0-0a40e385b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:29:55.361482 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b95c0d7e-7629-44b2-898b-4f46f1083a1e tempest-VolumesMetadataTest-1654307535 None] Created volume successfully.
Sep 06 11:29:57.654188 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Acquiring lock "cinder-7edd06af-2e8a-46fc-9446-35740d4e2074-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:29:57.665439 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Lock "cinder-7edd06af-2e8a-46fc-9446-35740d4e2074-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:29:57.808386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:29:57.997386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:29:57.998217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Volume volume-7edd06af-2e8a-46fc-9446-35740d4e2074 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:29:58.117527 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] deleting rbd volume volume-7edd06af-2e8a-46fc-9446-35740d4e2074 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:00.199263 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:30:00.200658 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:00.229469 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:00.360632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:01.290051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:01.309803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Flow 'volume_create_manager' (66a681b9-8913-4b04-95a4-9adaa017abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:01.316176 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acccc95f-88af-4b1b-9988-647f153a57af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:01.333043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acccc95f-88af-4b1b-9988-647f153a57af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1698664658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc688872-336e-441a-8357-ed7c3b2b6645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c75453d515a48488ee030bb0cadea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:01Z,use_quota=True,user_id='f55dcf04dff74414bd3828c62a35da94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:01.340262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af503c86-3254-416e-bcec-e49a063806ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:01.344593 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af503c86-3254-416e-bcec-e49a063806ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:01.350213 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9155dc-5e69-4c27-9b8e-00e3d7703d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:01.354248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9155dc-5e69-4c27-9b8e-00e3d7703d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc688872-336e-441a-8357-ed7c3b2b6645', 'volume_name': 'volume-dc688872-336e-441a-8357-ed7c3b2b6645', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:01.358958 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09361914-5fd2-4a1b-81b7-6ae93bb70fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:01.362968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09361914-5fd2-4a1b-81b7-6ae93bb70fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:01.373027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6423f2-8a4d-4ba6-907b-0302697aa316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:01.373027 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Volume dc688872-336e-441a-8357-ed7c3b2b6645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc688872-336e-441a-8357-ed7c3b2b6645', 'volume_size': 1}
Sep 06 11:30:01.373027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] creating volume 'volume-dc688872-336e-441a-8357-ed7c3b2b6645' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:01.373027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:02.321311 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Created reservations ['edbb1c37-dd2e-4f21-bf21-8e2aba6c1cf3', 'f702d612-0355-424e-be3a-ed8a855e37b7', 'c6cb5d30-6991-47fb-b01e-52395004aef5', '4297a46a-4b7c-4cb9-aa8f-360f3a2329df'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:02.326825 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:30:02.573165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:02.573556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:02.577632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6423f2-8a4d-4ba6-907b-0302697aa316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc688872-336e-441a-8357-ed7c3b2b6645', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:02.582083 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d925ab0-d8fa-49d2-913f-5bf7bd4c3def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:02.595459 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:02.638630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:02.668391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:02.672826 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Volume volume-dc688872-336e-441a-8357-ed7c3b2b6645 (dc688872-336e-441a-8357-ed7c3b2b6645): created successfully
Sep 06 11:30:02.677131 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d925ab0-d8fa-49d2-913f-5bf7bd4c3def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:02.682525 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Flow 'volume_create_manager' (66a681b9-8913-4b04-95a4-9adaa017abea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:02.687108 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Deleted volume successfully.
Sep 06 11:30:02.768194 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8eb01e28-d8c8-42b8-922a-e2ac5fb9403b tempest-VolumesMetadataTest-1654307535 None] Lock "cinder-7edd06af-2e8a-46fc-9446-35740d4e2074-delete_volume" released by "delete_volume" :: held 5.103s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:02.792124 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ca5d5dbb-1f9e-4717-9d55-dcf7e3b13d3f tempest-VolumesDeleteCascade-1048289034 None] Created volume successfully.
Sep 06 11:30:03.999918 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4de29992-0572-4dee-b6f6-68f2eb26c2da tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:06.625587 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4de29992-0572-4dee-b6f6-68f2eb26c2da tempest-VolumesDeleteCascade-1048289034 None] Create snapshot completed successfully
Sep 06 11:30:07.512512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3d997683-d894-4205-b1c4-fedd4ebf473f tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:08.996672 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:09.019271 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Flow 'volume_create_manager' (71f398f4-8acf-4eec-bd6c-0b63335718fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:09.027156 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d38c042-5500-462b-9d65-6cb46a335bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:09.046056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d38c042-5500-462b-9d65-6cb46a335bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-123836190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3d32fde-fb81-428b-9a5e-71eb8d363b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3f0c7137c468f8689c36e97e7d085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:09Z,use_quota=True,user_id='de0523a635564f69b31a24c07ed96779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:09.052140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c54c00-af64-42b8-86a8-5b53dc34aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:09.056329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c54c00-af64-42b8-86a8-5b53dc34aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:09.061410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc8cff8-52de-433f-b39d-d2ac8763bf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:09.065580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc8cff8-52de-433f-b39d-d2ac8763bf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d32fde-fb81-428b-9a5e-71eb8d363b45', 'volume_name': 'volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:09.071251 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8e4748-6196-4fce-b2a0-e391ef32b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:09.075271 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8e4748-6196-4fce-b2a0-e391ef32b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:09.080007 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7443dcb-8201-443e-86a8-9003d7076b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:09.081128 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Volume f3d32fde-fb81-428b-9a5e-71eb8d363b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45', 'volume_size': 1}
Sep 06 11:30:09.081538 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] creating volume 'volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:09.082353 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:10.583869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:10.585250 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:10.590965 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7443dcb-8201-443e-86a8-9003d7076b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:10.596050 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa82098-9fcb-4d8a-8860-ad21b8ca8c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:10.688503 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Volume volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45 (f3d32fde-fb81-428b-9a5e-71eb8d363b45): created successfully
Sep 06 11:30:10.692787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa82098-9fcb-4d8a-8860-ad21b8ca8c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:10.700880 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Flow 'volume_create_manager' (71f398f4-8acf-4eec-bd6c-0b63335718fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:10.826928 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-267e1b35-9803-490c-af99-9a09b55a9025 tempest-VolumesTransfersV357Test-1144353843 None] Created volume successfully.
Sep 06 11:30:11.314851 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3d997683-d894-4205-b1c4-fedd4ebf473f tempest-VolumesDeleteCascade-1048289034 None] Create snapshot completed successfully
Sep 06 11:30:12.071145 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Acquiring lock "cinder-dc688872-336e-441a-8357-ed7c3b2b6645-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:12.090324 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-dc688872-336e-441a-8357-ed7c3b2b6645-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:12.171204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Performing cascade delete. {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}}
Sep 06 11:30:12.183243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Acquiring lock "cinder-a4a83d34-0c6c-4fa7-a445-19c4d698e222-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:12.193128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-a4a83d34-0c6c-4fa7-a445-19c4d698e222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:12.207464 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:12.364053 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-bc6dca51-8843-454e-ab4c-266dc7198675 tempest-VolumesTransfersV357Test-1294689009 None] Transfer volume completed successfully.
Sep 06 11:30:13.543207 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Acquiring lock "cinder-f3d32fde-fb81-428b-9a5e-71eb8d363b45-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:13.555357 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Lock "cinder-f3d32fde-fb81-428b-9a5e-71eb8d363b45-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:13.652898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:13.783422 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:30:13.784128 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Volume volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:30:13.905547 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] deleting rbd volume volume-f3d32fde-fb81-428b-9a5e-71eb8d363b45 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:16.215729 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Created reservations ['0319a52c-8c58-4df2-a8bc-00366dc7b666', '40f1cfad-bd04-435a-824f-52bafa3f0c2c', '8f4b6bbb-b7bd-4b70-8cc7-afe87e75c785', 'c16a3eb8-6883-43d3-91ec-2d564a1c7348'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:16.413115 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Delete snapshot completed successfully.
Sep 06 11:30:16.418354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-a4a83d34-0c6c-4fa7-a445-19c4d698e222-delete_snapshot" released by "delete_snapshot" :: held 4.225s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:16.419357 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Acquiring lock "cinder-aaedb787-9723-4bda-9e2b-738400fcbad7-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:16.437062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-aaedb787-9723-4bda-9e2b-738400fcbad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:16.456179 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:20.317100 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Created reservations ['90b98ac2-d1ba-401a-8fc3-40375d6ec80a', '09f32c77-679b-45ec-919a-639e7f39701f', 'c2b19fb2-808d-4eb3-974a-a2da59e410bb', '47c32110-0c4c-47c9-8e22-3233aa7d7d17'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:20.321301 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:30:20.496515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Created reservations ['57b37030-f3e8-4fc6-9e5b-d9c434cf1cab', 'f47fc31d-69a1-46e4-80eb-3899516b87a3', 'dc4b93bd-754f-4be3-a796-2cdf4ab58f67', '43067462-b51c-47b1-ae36-cc63462dd3b2'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:20.654250 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Delete snapshot completed successfully.
Sep 06 11:30:20.676467 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-aaedb787-9723-4bda-9e2b-738400fcbad7-delete_snapshot" released by "delete_snapshot" :: held 4.230s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:20.678457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Snapshots deleted, issuing volume delete {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}}
Sep 06 11:30:20.681452 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:21.149045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:30:21.152425 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Volume volume-dc688872-336e-441a-8357-ed7c3b2b6645 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:30:21.288481 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] deleting rbd volume volume-dc688872-336e-441a-8357-ed7c3b2b6645 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:21.304758 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=9 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:30:21.415101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:21.445336 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:21.482922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:21.488357 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Deleted volume successfully.
Sep 06 11:30:21.572858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-79e8d010-5e1d-4df8-9d66-41ac51f01fcc tempest-VolumesTransfersV357Test-1830573097 None] Lock "cinder-f3d32fde-fb81-428b-9a5e-71eb8d363b45-delete_volume" released by "delete_volume" :: held 8.017s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:21.985011 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:22.008064 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Flow 'volume_create_manager' (5360d9fe-673e-460f-9ada-f571b3125795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:22.016621 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d15a8b0-ce9c-401b-b4ff-2587917554c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:22.035492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d15a8b0-ce9c-401b-b4ff-2587917554c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1824725422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a507eef8-463f-44e6-a4dd-4a8fac7f0223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b3f0c7137c468f8689c36e97e7d085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:22Z,use_quota=True,user_id='de0523a635564f69b31a24c07ed96779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:22.041504 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31acfef7-a3ca-4cf1-b043-824f3fd6e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:22.045897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31acfef7-a3ca-4cf1-b043-824f3fd6e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:22.050734 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119c1f5-db02-4d05-82d1-473980773058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:22.054852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119c1f5-db02-4d05-82d1-473980773058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a507eef8-463f-44e6-a4dd-4a8fac7f0223', 'volume_name': 'volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:22.059880 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0134d-e764-4186-bdae-c862630cc56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:22.064062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa0134d-e764-4186-bdae-c862630cc56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:22.070884 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14946054-d45a-467c-8f96-a84c9516d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:22.072502 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Volume a507eef8-463f-44e6-a4dd-4a8fac7f0223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223', 'volume_size': 1}
Sep 06 11:30:22.073161 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] creating volume 'volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:22.074769 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:23.342750 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:23.343477 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:23.348326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14946054-d45a-467c-8f96-a84c9516d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:23.352984 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d77228-a66e-4b0b-bcbe-bf60f3b872a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:23.454092 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Volume volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223 (a507eef8-463f-44e6-a4dd-4a8fac7f0223): created successfully
Sep 06 11:30:23.468011 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d77228-a66e-4b0b-bcbe-bf60f3b872a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:23.468011 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Flow 'volume_create_manager' (5360d9fe-673e-460f-9ada-f571b3125795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:23.584062 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d472a859-c907-4e68-959d-1b4a24947b60 tempest-VolumesTransfersV357Test-1144353843 None] Created volume successfully.
Sep 06 11:30:24.543216 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Acquiring lock "cinder-a507eef8-463f-44e6-a4dd-4a8fac7f0223-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:24.558719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Lock "cinder-a507eef8-463f-44e6-a4dd-4a8fac7f0223-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:24.725957 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:25.002210 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:30:25.002715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Volume volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:30:25.276967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] deleting rbd volume volume-a507eef8-463f-44e6-a4dd-4a8fac7f0223 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:26.917504 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Created reservations ['4c7649f1-45c9-4c28-aa27-a37b2ef73805', 'b507eee0-f664-41e0-8d69-55306c07118e', '08bd009c-38ec-481e-991b-474a8f466976', '566305d8-24da-4e4d-829a-6f0ad5b98573'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:27.101333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:27.152211 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:27.222355 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:27.245145 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Deleted volume successfully.
Sep 06 11:30:27.339512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0108abaa-5c08-4b19-aef3-f176ac89a3b1 tempest-VolumesDeleteCascade-1048289034 None] Lock "cinder-dc688872-336e-441a-8357-ed7c3b2b6645-delete_volume" released by "delete_volume" :: held 15.249s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:29.917766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Created reservations ['4a7e5eb9-94a0-4356-a246-c38d0b4f4ac5', 'af63d2b0-a44e-4b26-884e-a373d58c5bd8', '295d25ae-a444-4e72-bcd9-b9699c530166', '95b60b5b-114e-4a7d-9709-5eba923c7432'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:30.107177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:30.163680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:30.224031 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:30.229263 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Deleted volume successfully.
Sep 06 11:30:30.298265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-cb23694a-ab65-4187-a63f-3e570dfb2e5e tempest-VolumesTransfersV357Test-1830573097 None] Lock "cinder-a507eef8-463f-44e6-a4dd-4a8fac7f0223-delete_volume" released by "delete_volume" :: held 5.740s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:34.087895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:34.116590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Flow 'volume_create_manager' (d5f404b5-ce00-4c5f-83f9-855f43a01b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:34.123502 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dd56bb-f554-45c5-8d61-cc12cbf62df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:34.141286 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dd56bb-f554-45c5-8d61-cc12cbf62df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-683693003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=01ba516b-b5ad-460b-bfda-6d0d2bd8389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a6a32c73364afb8ec72aca84139e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:34Z,use_quota=True,user_id='23bf78cf79b84662bb88e7988944785f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:34.147690 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02100b27-64f1-4671-9ab9-86ec248650ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:34.152799 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02100b27-64f1-4671-9ab9-86ec248650ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:34.158569 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2126c4-bb75-4d79-8f36-78cecc55fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:34.163826 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2126c4-bb75-4d79-8f36-78cecc55fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ba516b-b5ad-460b-bfda-6d0d2bd8389c', 'volume_name': 'volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:34.170182 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3121a6ff-0305-4def-ba90-b1e394e11bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:34.174487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3121a6ff-0305-4def-ba90-b1e394e11bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:34.180174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657f5e3f-8667-4000-97d2-86ebcf9c92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:34.181483 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Volume 01ba516b-b5ad-460b-bfda-6d0d2bd8389c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c', 'volume_size': 1}
Sep 06 11:30:34.182024 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] creating volume 'volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:34.182961 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:34.964405 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:34.964405 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:34.967820 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657f5e3f-8667-4000-97d2-86ebcf9c92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:34.974207 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8502b3-d5c0-4689-a4b0-317214b26eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:35.043201 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Volume volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c (01ba516b-b5ad-460b-bfda-6d0d2bd8389c): created successfully
Sep 06 11:30:35.048228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8502b3-d5c0-4689-a4b0-317214b26eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:35.055265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Flow 'volume_create_manager' (d5f404b5-ce00-4c5f-83f9-855f43a01b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:35.190115 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d4ce1d86-2674-4b9b-a5ca-4af3306de827 tempest-VolumesTransfersV355Test-2072390205 None] Created volume successfully.
Sep 06 11:30:37.672308 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-42aaae5d-4d16-43ee-a6ab-1a686ef48aa3 tempest-VolumesTransfersV355Test-1827611038 None] Transfer volume completed successfully.
Sep 06 11:30:38.117539 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:38.137351 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (6da9b9fc-753c-4312-bc18-3319b4fca355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:38.144699 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0dfe50e-ff8f-40e9-8b67-4b233bee4b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:38.161257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0dfe50e-ff8f-40e9-8b67-4b233bee4b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2104817143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f4eb326-623e-49b5-80c8-22c1dc568e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b461b8622c143ce8f77d8b48970cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:38Z,use_quota=True,user_id='0f883ece2e5e49698d2bd382ab3a40dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:38.166525 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84f95db-cdd0-4dc8-b3f6-76fa31395586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:38.170588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84f95db-cdd0-4dc8-b3f6-76fa31395586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:38.176091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1716d907-6fe5-45a5-b736-41d767c4226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:38.180150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1716d907-6fe5-45a5-b736-41d767c4226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4eb326-623e-49b5-80c8-22c1dc568e07', 'volume_name': 'volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:38.184973 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7d4a26-3771-46b5-aff9-862f80677a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:38.188868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7d4a26-3771-46b5-aff9-862f80677a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:38.194150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760c41ef-e496-41de-b9b0-a1ef9468a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:38.195262 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Volume 4f4eb326-623e-49b5-80c8-22c1dc568e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'volume_size': 1}
Sep 06 11:30:38.195667 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] creating volume 'volume-4f4eb326-623e-49b5-80c8-22c1dc568e07' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:38.202068 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:38.860901 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Acquiring lock "cinder-01ba516b-b5ad-460b-bfda-6d0d2bd8389c-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:38.871661 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Lock "cinder-01ba516b-b5ad-460b-bfda-6d0d2bd8389c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:38.899243 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:38.900056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:38.905749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760c41ef-e496-41de-b9b0-a1ef9468a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:38.911590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9272e3-6222-4c1d-9c2c-89d069fea4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:39.009305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:39.208110 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:30:39.208540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Volume volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:30:39.448840 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] deleting rbd volume volume-01ba516b-b5ad-460b-bfda-6d0d2bd8389c {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:39.460220 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Volume volume-4f4eb326-623e-49b5-80c8-22c1dc568e07 (4f4eb326-623e-49b5-80c8-22c1dc568e07): created successfully
Sep 06 11:30:39.470147 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9272e3-6222-4c1d-9c2c-89d069fea4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:39.480943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (6da9b9fc-753c-4312-bc18-3319b4fca355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:39.595742 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ce1abd3e-95b2-4ba0-989f-45112af34494 tempest-VolumesBackupsTest-639521729 None] Created volume successfully.
Sep 06 11:30:43.814170 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Created reservations ['b4411044-5723-494e-96dc-b559b7401e25', 'ba9f2c48-e2c3-4726-a2d8-69deca514b3c', 'bf505a21-58cd-4e38-b72d-91071277561c', 'e86f85b9-947d-488d-8960-5d23fe92959a'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:43.825883 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:30:44.031588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:44.063447 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:44.114384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:44.120314 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Deleted volume successfully.
Sep 06 11:30:44.226650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4e9836ba-dd49-48ba-96a5-11014808060d tempest-VolumesTransfersV355Test-381184635 None] Lock "cinder-01ba516b-b5ad-460b-bfda-6d0d2bd8389c-delete_volume" released by "delete_volume" :: held 5.355s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:45.365375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:30:45.387285 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Flow 'volume_create_manager' (30eaff4d-442b-4104-86ab-f8f3bd7a4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:45.394171 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867a252-cd4c-49f4-8811-0c763f929e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:45.413364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867a252-cd4c-49f4-8811-0c763f929e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118595004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=286be48d-f111-445a-842a-be9700d5f54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a6a32c73364afb8ec72aca84139e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:30:45Z,use_quota=True,user_id='23bf78cf79b84662bb88e7988944785f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:45.419899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b200ca5a-7139-497a-af66-899a5946c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:45.424839 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b200ca5a-7139-497a-af66-899a5946c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:45.430119 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8262815-4291-4ee9-bc5c-0fc61286dd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:45.434658 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8262815-4291-4ee9-bc5c-0fc61286dd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286be48d-f111-445a-842a-be9700d5f54e', 'volume_name': 'volume-286be48d-f111-445a-842a-be9700d5f54e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:45.439912 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59876ca7-252e-4dba-a2ce-b7e7ee5c41df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:45.443955 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59876ca7-252e-4dba-a2ce-b7e7ee5c41df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:45.448873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503174ea-c4a8-4766-9570-48d139f96230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:45.450120 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Volume 286be48d-f111-445a-842a-be9700d5f54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286be48d-f111-445a-842a-be9700d5f54e', 'volume_size': 1}
Sep 06 11:30:45.450740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] creating volume 'volume-286be48d-f111-445a-842a-be9700d5f54e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:30:45.451921 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:46.318935 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:30:46.319718 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:30:46.328172 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503174ea-c4a8-4766-9570-48d139f96230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286be48d-f111-445a-842a-be9700d5f54e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:46.331251 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6aca2f-70e4-4a5d-9443-aa0dd1af9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:30:46.407829 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Volume volume-286be48d-f111-445a-842a-be9700d5f54e (286be48d-f111-445a-842a-be9700d5f54e): created successfully
Sep 06 11:30:46.411891 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6aca2f-70e4-4a5d-9443-aa0dd1af9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:30:46.417339 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Flow 'volume_create_manager' (30eaff4d-442b-4104-86ab-f8f3bd7a4219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:30:46.499550 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d47fc96c-e25f-47d4-a944-64040216c385 tempest-VolumesTransfersV355Test-2072390205 None] Created volume successfully.
Sep 06 11:30:47.952488 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Acquiring lock "cinder-286be48d-f111-445a-842a-be9700d5f54e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:30:47.981749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Lock "cinder-286be48d-f111-445a-842a-be9700d5f54e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:30:48.081771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:48.310498 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:30:48.311427 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Volume volume-286be48d-f111-445a-842a-be9700d5f54e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:30:48.492489 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] deleting rbd volume volume-286be48d-f111-445a-842a-be9700d5f54e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:30:52.735217 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=36,cinder:SELECT=49,cinder:INSERT=11,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:30:52.849680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Created reservations ['dcf70488-5a87-429c-9663-8067fc0387d8', 'f9d0e9b7-79cc-4420-a37d-c95d8c833171', '12b86e5e-20b4-4b73-aef6-7b80305c5043', '2ccaca94-b561-4db4-8e8a-7ad0bb9dc8bf'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:30:53.047405 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:53.097702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:30:53.186967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:30:53.199220 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Deleted volume successfully.
Sep 06 11:30:53.276479 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f1f00835-e4ce-4891-9737-988250dc4f1d tempest-VolumesTransfersV355Test-381184635 None] Lock "cinder-286be48d-f111-445a-842a-be9700d5f54e-delete_volume" released by "delete_volume" :: held 5.298s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:30:55.813812 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-21af801c-ee79-4a92-9942-c48a26794145 req-4f7c4d03-f650-467f-a5d8-e30d34fc5b9d tempest-VolumesBackupsTest-639521729 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:30:56.662518 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-21af801c-ee79-4a92-9942-c48a26794145 req-4f7c4d03-f650-467f-a5d8-e30d34fc5b9d tempest-VolumesBackupsTest-639521729 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.838s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:30:56.663821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-21af801c-ee79-4a92-9942-c48a26794145 req-4f7c4d03-f650-467f-a5d8-e30d34fc5b9d tempest-VolumesBackupsTest-639521729 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4f4eb326-623e-49b5-80c8-22c1dc568e07', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:30:56.836239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-21af801c-ee79-4a92-9942-c48a26794145 req-4f7c4d03-f650-467f-a5d8-e30d34fc5b9d tempest-VolumesBackupsTest-639521729 None] Connection info returned from driver {'name': 'volumes/volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4f4eb326-623e-49b5-80c8-22c1dc568e07', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b3c60c0f-e4df-4ae5-962e-fc7dfd3d1287'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:30:57.015426 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-21af801c-ee79-4a92-9942-c48a26794145 req-4f7c4d03-f650-467f-a5d8-e30d34fc5b9d tempest-VolumesBackupsTest-639521729 None] attachment_update completed successfully.
Sep 06 11:31:00.197221 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:31:00.198510 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:00.243651 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:00.278631 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:31:00.817644 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:31:00Z,data_timestamp=2022-09-06T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1353256139',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=15e394eb-e714-4277-ab11-63a98cbe94f4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0b461b8622c143ce8f77d8b48970cade',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='0f883ece2e5e49698d2bd382ab3a40dd',volume_id=4f4eb326-623e-49b5-80c8-22c1dc568e07)
Sep 06 11:31:00.818884 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] continue_backup in rpcapi backup_id 15e394eb-e714-4277-ab11-63a98cbe94f4 {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:31:00.944742 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:31:01.785807 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.841s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:31:01.786856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f4eb326-623e-49b5-80c8-22c1dc568e07', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4f4eb326-623e-49b5-80c8-22c1dc568e07', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:31:01.804198 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] Initialize volume connection completed successfully.
Sep 06 11:31:02.644082 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:31:02.665265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (4e34e0ef-4d3f-42bd-9a82-aa284f0eb1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:31:02.685471 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe0e626-7e95-4cfa-a2ab-6a6ea4ddd585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:02.709479 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe0e626-7e95-4cfa-a2ab-6a6ea4ddd585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2120549652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=19567f19-1cb2-4e80-bf09-e8c419539694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:31:02Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:02.714811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d183b2-b5f9-4031-ae5d-30ac92905672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:02.718980 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d183b2-b5f9-4031-ae5d-30ac92905672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:02.724530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a0ab16-4e73-4d8e-b88e-09c4214d418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:02.728570 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a0ab16-4e73-4d8e-b88e-09c4214d418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19567f19-1cb2-4e80-bf09-e8c419539694', 'volume_name': 'volume-19567f19-1cb2-4e80-bf09-e8c419539694', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:02.733502 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806a697-196f-48b6-815b-da2a7780ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:02.738094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806a697-196f-48b6-815b-da2a7780ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:02.742848 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af67588-97e3-4b90-93ed-6444c88505d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:02.743954 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Volume 19567f19-1cb2-4e80-bf09-e8c419539694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19567f19-1cb2-4e80-bf09-e8c419539694', 'volume_size': 1}
Sep 06 11:31:02.744368 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] creating volume 'volume-19567f19-1cb2-4e80-bf09-e8c419539694' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:31:02.745503 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:03.240369 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:31:03.241715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:31:03.247580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af67588-97e3-4b90-93ed-6444c88505d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19567f19-1cb2-4e80-bf09-e8c419539694', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:03.254825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f177e32b-0eb9-49be-9f60-fb9994e91770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:03.319913 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-19567f19-1cb2-4e80-bf09-e8c419539694 (19567f19-1cb2-4e80-bf09-e8c419539694): created successfully
Sep 06 11:31:03.323730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f177e32b-0eb9-49be-9f60-fb9994e91770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:03.330869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (4e34e0ef-4d3f-42bd-9a82-aa284f0eb1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:31:03.476609 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6a2fc217-fcb3-457d-bcdb-24ed6a77fe5e tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:31:04.272187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4a261797-1528-4202-8c51-2f4e45d23269 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:06.905588 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4a261797-1528-4202-8c51-2f4e45d23269 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:31:09.359076 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] Terminate volume connection completed successfully.
Sep 06 11:31:09.402277 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ed6d0455-a6c3-4566-b19f-e373d9c23e1e tempest-VolumesBackupsTest-639521729 None] Remove volume export completed successfully.
Sep 06 11:31:09.510426 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.driver [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Creating a new backup for volume volume-19567f19-1cb2-4e80-bf09-e8c419539694. {{(pid=133823) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1218}}
Sep 06 11:31:09.680107 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] cloning volumes/volume-19567f19-1cb2-4e80-bf09-e8c419539694@snapshot-51b6f2a0-c9c2-4550-b860-8bbb4cd500d1 to volume-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5 {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:31:09.680754 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:09.731663 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:11.762237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:31:11.762817 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:31:11.981512 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:31:07Z,data_timestamp=2022-09-06T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1661407502',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=be548302-421e-4937-ae7c-6d90ab1bf7ab,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='eb7c997d05c141afb82389298ecb372c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='51b6f2a0-c9c2-4550-b860-8bbb4cd500d1',status='creating',temp_snapshot_id=None,temp_volume_id='ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5',updated_at=None,user_id='4a1fe9d40733413a9c56393762549c7d',volume_id=19567f19-1cb2-4e80-bf09-e8c419539694)
Sep 06 11:31:11.984697 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] continue_backup in rpcapi backup_id be548302-421e-4937-ae7c-6d90ab1bf7ab {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:31:12.103374 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:31:12.966227 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.863s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:31:12.967351 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:31:12.984410 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Initialize volume connection completed successfully.
Sep 06 11:31:21.298511 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:31:24.871083 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-3d1adbff-d712-4138-9452-c9d3a51506f7 req-39e5ad2f-5e00-4fe4-961b-13222a9c466b tempest-VolumesBackupsTest-639521729 None] Terminate volume connection completed successfully.
Sep 06 11:31:24.872252 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-3d1adbff-d712-4138-9452-c9d3a51506f7 req-39e5ad2f-5e00-4fe4-961b-13222a9c466b tempest-VolumesBackupsTest-639521729 None] Deleting attachment b3c60c0f-e4df-4ae5-962e-fc7dfd3d1287. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:31:29.897247 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Acquiring lock "cinder-4f4eb326-623e-49b5-80c8-22c1dc568e07-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:31:29.916046 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-4f4eb326-623e-49b5-80c8-22c1dc568e07-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:31:29.918378 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=44,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:31:30.052084 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:33.902906 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Volume volume-4f4eb326-623e-49b5-80c8-22c1dc568e07 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:31:34.967762 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] deleting rbd volume volume-4f4eb326-623e-49b5-80c8-22c1dc568e07 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:31:44.566112 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Created reservations ['877fcaf3-8799-4ccb-aa8b-1c7418a7c975', '60ad5854-4d18-47f5-806b-ff73fbb46e62', '0b1db98e-3f63-4978-b011-41e38cdd5c92', '1c855a2f-94a3-4829-afa8-15cdd60d6b8e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:31:44.774092 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:44.823034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:44.883325 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:31:44.888356 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Deleted volume successfully.
Sep 06 11:31:44.981534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-eaa0bc01-5cf5-4cbc-869a-9e16609fa2b7 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-4f4eb326-623e-49b5-80c8-22c1dc568e07-delete_volume" released by "delete_volume" :: held 15.065s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:31:46.335265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:31:46.355340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (a500b72b-3b36-48f7-993d-e57e65d288a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:31:46.362002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c88e9a-30d0-4635-b2e3-5ee5a8915758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:46.382876 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c88e9a-30d0-4635-b2e3-5ee5a8915758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1465343315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd21d98c-616b-4c7a-b954-b1a23411e049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b461b8622c143ce8f77d8b48970cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:31:46Z,use_quota=True,user_id='0f883ece2e5e49698d2bd382ab3a40dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:46.388101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c4d65c-9529-4a6f-9b4e-ffefa62e9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:46.393543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c4d65c-9529-4a6f-9b4e-ffefa62e9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:46.398045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c26ba-b3e4-4791-a819-7f98af65243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:46.509904 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c26ba-b3e4-4791-a819-7f98af65243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd21d98c-616b-4c7a-b954-b1a23411e049', 'volume_name': 'volume-bd21d98c-616b-4c7a-b954-b1a23411e049', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702d8e80>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:46.515144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc5f484-16ec-4c25-9ae3-18e471d59b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:46.519049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc5f484-16ec-4c25-9ae3-18e471d59b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:46.523554 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26048d4e-a657-448c-99f8-24e26f88fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:46.525965 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Volume bd21d98c-616b-4c7a-b954-b1a23411e049: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd21d98c-616b-4c7a-b954-b1a23411e049', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702d8e80>}
Sep 06 11:31:46.525965 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Cloning bd21d98c-616b-4c7a-b954-b1a23411e049 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:31:46.526309 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:31:46.540345 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:31:46.681582 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 31, 46, 544869)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:31:46.682113 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:31:46.682537 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:31:46.687250 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.147s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:31:46.688810 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:31:46.696719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 31, 46, 693354)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:31:46.697174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:31:46.697679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:31:46.710374 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:31:47.099409 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] creating snapshot='volume-bd21d98c-616b-4c7a-b954-b1a23411e049.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:31:50.173720 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-bd21d98c-616b-4c7a-b954-b1a23411e049.clone_snap' to 'volume-bd21d98c-616b-4c7a-b954-b1a23411e049' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:31:52.622712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:31:52.625061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:31:52.625609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:31:53.457181 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:31:53.457857 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Marking volume bd21d98c-616b-4c7a-b954-b1a23411e049 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:31:53.462583 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=25,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:31:53.553614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to bd21d98c-616b-4c7a-b954-b1a23411e049. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:31:53.554057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Creating volume glance metadata for volume bd21d98c-616b-4c7a-b954-b1a23411e049 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:31:53.712145 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26048d4e-a657-448c-99f8-24e26f88fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd21d98c-616b-4c7a-b954-b1a23411e049', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702d8e80>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:53.716851 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61096c8-0a9a-407c-bbe5-f313ae1df673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:31:53.846627 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Volume volume-bd21d98c-616b-4c7a-b954-b1a23411e049 (bd21d98c-616b-4c7a-b954-b1a23411e049): created successfully
Sep 06 11:31:53.850648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61096c8-0a9a-407c-bbe5-f313ae1df673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:31:53.856936 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (a500b72b-3b36-48f7-993d-e57e65d288a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:31:53.921502 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-42267adf-e386-4064-88f1-9b0079e01056 tempest-VolumesBackupsTest-639521729 None] Created volume successfully.
Sep 06 11:31:55.296512 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-09-06T11:31:54Z,data_timestamp=2022-09-06T11:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1856593557',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cc3cad99-aa23-4030-b44b-882f74d8ed6f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0b461b8622c143ce8f77d8b48970cade',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='0f883ece2e5e49698d2bd382ab3a40dd',volume_id=bd21d98c-616b-4c7a-b954-b1a23411e049)
Sep 06 11:31:55.298058 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.backup.rpcapi [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] continue_backup in rpcapi backup_id cc3cad99-aa23-4030-b44b-882f74d8ed6f {{(pid=133823) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Sep 06 11:31:55.436262 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:31:56.287829 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.851s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:31:56.288863 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bd21d98c-616b-4c7a-b954-b1a23411e049', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'bd21d98c-616b-4c7a-b954-b1a23411e049', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:31:56.306739 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] Initialize volume connection completed successfully.
Sep 06 11:32:00.195186 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:32:00.196528 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:32:00.247578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:32:00.286672 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:32:14.981773 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=39,cinder:INSERT=13,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:32:24.980638 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:32:34.989907 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:32:51.091340 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-577c940f-e572-439d-90ea-89c5f4b9e4b4 tempest-GroupsV314Test-733201494 None] Group tempest-GroupsV314Test-Group-71759589: creating
Sep 06 11:32:51.184168 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-577c940f-e572-439d-90ea-89c5f4b9e4b4 tempest-GroupsV314Test-733201494 None] Group tempest-GroupsV314Test-Group-71759589: created successfully
Sep 06 11:32:51.194555 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-577c940f-e572-439d-90ea-89c5f4b9e4b4 tempest-GroupsV314Test-733201494 None] Create group completed successfully.
Sep 06 11:32:53.127100 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:32:53.147774 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Flow 'volume_create_manager' (94a4f379-16c2-4846-bcf5-757233efc0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:32:53.154493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5dd39b-8752-4eed-819f-5921b2c2b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:53.171583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5dd39b-8752-4eed-819f-5921b2c2b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1888605984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38fa6d1d-2326-4dfb-8ca8-436a7cb4e751,host='ncdv-master-1@ceph#ceph',id=78357200-c33d-4b0c-9336-c61a914533a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540c0ed0b8a4305a289a9e0e8164f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:32:53Z,use_quota=True,user_id='a8a9fcecdbdc4c0bb81f9d6484fc01e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46a1efe1-a713-4915-8e2a-ae71ab380c72),volume_type_id=46a1efe1-a713-4915-8e2a-ae71ab380c72)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:53.176727 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fe8558-405f-4e96-bd93-19d9858e4515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:53.180688 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fe8558-405f-4e96-bd93-19d9858e4515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:53.185601 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882444ef-8110-47f7-bcbf-45b92a46ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:53.190252 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882444ef-8110-47f7-bcbf-45b92a46ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78357200-c33d-4b0c-9336-c61a914533a3', 'volume_name': 'volume-78357200-c33d-4b0c-9336-c61a914533a3', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:53.195056 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54d506d-6866-48a2-b7ae-1e2f73284aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:53.198896 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54d506d-6866-48a2-b7ae-1e2f73284aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:53.205597 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d14b4c2-fa0c-45bb-92d2-96658c837b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:53.205597 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Volume 78357200-c33d-4b0c-9336-c61a914533a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78357200-c33d-4b0c-9336-c61a914533a3', 'volume_size': 1}
Sep 06 11:32:53.205597 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] creating volume 'volume-78357200-c33d-4b0c-9336-c61a914533a3' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:32:53.205858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:32:56.123845 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:32:56.124491 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:32:56.128071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d14b4c2-fa0c-45bb-92d2-96658c837b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78357200-c33d-4b0c-9336-c61a914533a3', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:56.132560 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccf8b6f-c866-4459-bb02-e5d765dad4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:32:56.137887 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:32:56.223656 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Volume volume-78357200-c33d-4b0c-9336-c61a914533a3 (78357200-c33d-4b0c-9336-c61a914533a3): created successfully
Sep 06 11:32:56.227494 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccf8b6f-c866-4459-bb02-e5d765dad4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:32:56.233093 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Flow 'volume_create_manager' (94a4f379-16c2-4846-bcf5-757233efc0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:32:56.337851 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c603b25f-c196-4762-8972-fb3b1161d673 tempest-GroupsV314Test-733201494 None] Created volume successfully.
Sep 06 11:32:58.283022 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:32:59.600237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] creating snapshot='volume-056e259b-3899-40e6-97c3-486779b86cf5.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:33:02.852944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] cloning 'volume-78357200-c33d-4b0c-9336-c61a914533a3@volume-056e259b-3899-40e6-97c3-486779b86cf5.clone_snap' to 'volume-056e259b-3899-40e6-97c3-486779b86cf5' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:33:02.856271 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:33:02.856904 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:02.971002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:02.993896 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:33:03.013057 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Terminate volume connection completed successfully.
Sep 06 11:33:03.032377 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Remove volume export completed successfully.
Sep 06 11:33:03.059121 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:33:03.067985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:33:03.081793 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:03.595280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:33:03.799746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:33:06.216025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] Volume volume-78357200-c33d-4b0c-9336-c61a914533a3 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:33:06.218949 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:33:06.222460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:33:06.222833 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:33:06.629688 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:33:06.982288 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-42371ac8-cf2a-46e5-b4eb-4d091a851b23 tempest-GroupsV314Test-733201494 None] Create group from source-group-38fa6d1d-2326-4dfb-8ca8-436a7cb4e751 completed successfully.
Sep 06 11:33:07.639403 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:07.881404 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:33:08.076642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] deleting rbd volume volume-056e259b-3899-40e6-97c3-486779b86cf5 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:33:11.103735 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:33:11.109072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-8bd3d1a7-fa30-4f4f-8d99-fa7f5339e552 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-ef9fdf53-4ef4-46c3-9fb2-f2da387ddfb5-delete_volume" released by "delete_volume" :: held 8.041s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:33:12.274302 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] Terminate volume connection completed successfully.
Sep 06 11:33:12.292842 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e885ee2b-1289-4b51-8cf0-712a3a394318 tempest-VolumesBackupsTest-639521729 None] Remove volume export completed successfully.
Sep 06 11:33:13.888280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:33:14.064155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Volume volume-78357200-c33d-4b0c-9336-c61a914533a3 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:33:14.064696 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] deleting parent snapshot volume-056e259b-3899-40e6-97c3-486779b86cf5.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:33:17.300272 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:33:17.328140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (3439195d-2966-472f-82b0-96b0345a892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:17.356052 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09142c80-37a3-4e49-93bd-2871d9cd3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:17.377720 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09142c80-37a3-4e49-93bd-2871d9cd3f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:33:14Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_cc3cad99-aa23-4030-b44b-882f74d8ed6f',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c493320-229d-4e12-a32f-aff0584e239e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b461b8622c143ce8f77d8b48970cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:33:14Z,use_quota=True,user_id='0f883ece2e5e49698d2bd382ab3a40dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:17.384301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a430a1-fe14-4d1c-b2f5-4beda7655aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:17.389423 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a430a1-fe14-4d1c-b2f5-4beda7655aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:17.399095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6930a3f9-22ad-486f-981d-c82f861acc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:17.400253 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6930a3f9-22ad-486f-981d-c82f861acc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c493320-229d-4e12-a32f-aff0584e239e', 'volume_name': 'volume-9c493320-229d-4e12-a32f-aff0584e239e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:17.406574 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89f2b1b-e39a-462a-afda-722f78953e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:17.411196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89f2b1b-e39a-462a-afda-722f78953e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:17.416944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6013155e-b406-4574-a0a5-875bd5bfb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:17.418890 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Volume 9c493320-229d-4e12-a32f-aff0584e239e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c493320-229d-4e12-a32f-aff0584e239e', 'volume_size': 1}
Sep 06 11:33:17.419614 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] creating volume 'volume-9c493320-229d-4e12-a32f-aff0584e239e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:33:17.420244 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:17.714924 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Created reservations ['d847624e-9fc8-40e5-a94b-9e329579895d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:33:17.733762 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1328252754 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1328252754, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:33:17.734593 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1328252754 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1328252754, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:33:17.892441 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Created reservations ['671d8070-4e1d-47ea-ba6f-58520db6d239', '6eb2afd0-95ad-413b-b713-eb2b43eba270', 'baf5b380-ce27-4691-8626-d5f7aec90593', 'fff0c6c2-be4f-448d-97ee-ee3e4a1a0015'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:33:18.124470 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:33:18.124850 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:33:18.128660 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6013155e-b406-4574-a0a5-875bd5bfb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c493320-229d-4e12-a32f-aff0584e239e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:18.133140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b3728-f4c8-41b6-836e-c354cddc84b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:18.221067 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Volume volume-9c493320-229d-4e12-a32f-aff0584e239e (9c493320-229d-4e12-a32f-aff0584e239e): created successfully
Sep 06 11:33:18.224789 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b3728-f4c8-41b6-836e-c354cddc84b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:18.230455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Flow 'volume_create_manager' (3439195d-2966-472f-82b0-96b0345a892c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:18.338614 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Created volume successfully.
Sep 06 11:33:18.374400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:18.401487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:18.430949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:33:18.449160 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-49473cc0-1e54-4485-ab56-419425502ec1 tempest-GroupsV314Test-733201494 None] Delete group completed successfully.
Sep 06 11:33:18.926661 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:19.100789 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:33:19.101132 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] Volume volume-78357200-c33d-4b0c-9336-c61a914533a3 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:33:19.193241 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] deleting rbd volume volume-78357200-c33d-4b0c-9336-c61a914533a3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:33:19.493189 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:33:20.316127 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.823s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:33:20.316902 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9c493320-229d-4e12-a32f-aff0584e239e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '9c493320-229d-4e12-a32f-aff0584e239e', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:33:20.333329 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Initialize volume connection completed successfully.
Sep 06 11:33:25.472225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] Created reservations ['3e5d4981-6bf3-45b8-9d85-3d75105965a0'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:33:25.663403 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] Created reservations ['d804325f-438e-40e1-810a-308501d52c85', '3f51e96b-abfb-4d35-9530-9d8089efe13d', 'e8f58696-76e0-4921-828c-2f5e4fd0a5cc', '8102b42f-1791-4966-9b34-d45379120d4c'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:33:26.021863 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:26.058279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:26.085973 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:33:26.095457 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ae86e3f7-55c1-4ba4-a9aa-d0254f9868f9 tempest-GroupsV314Test-733201494 None] Delete group completed successfully.
Sep 06 11:33:27.193927 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=71,cinder:UPDATE=27,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:33:30.522163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:33:30.546114 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (8642f0a7-e06a-4586-b2b5-c8ebbadde7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:30.552488 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac56b0e-29ae-404c-8f77-25a542c91619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:30.571433 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac56b0e-29ae-404c-8f77-25a542c91619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2093056530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d811911f-7135-4822-aa2d-99ff0b4a1787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:33:30Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:30.577889 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66967047-d17f-445d-b908-3c4f457329b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:30.582135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66967047-d17f-445d-b908-3c4f457329b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:30.587254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600c1893-5150-46e3-96a6-609c3a4e221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:30.680549 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600c1893-5150-46e3-96a6-609c3a4e221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd811911f-7135-4822-aa2d-99ff0b4a1787', 'volume_name': 'volume-d811911f-7135-4822-aa2d-99ff0b4a1787', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704ae340>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:30.686118 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80310d06-4a47-44af-9bac-a341a22c357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:30.690043 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80310d06-4a47-44af-9bac-a341a22c357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:30.696124 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e389dd9-8bd0-49bb-9e76-0ae3819462f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:30.697384 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume d811911f-7135-4822-aa2d-99ff0b4a1787: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d811911f-7135-4822-aa2d-99ff0b4a1787', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704ae340>}
Sep 06 11:33:30.702942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Cloning d811911f-7135-4822-aa2d-99ff0b4a1787 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:33:30.702942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:33:30.707342 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:33:30.792393 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 33, 30, 711564)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:33:30.796305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:33:30.796305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:33:30.806101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.099s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:33:30.807640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:33:30.818376 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 33, 30, 814223)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:33:30.819297 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:33:30.819728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:33:30.833733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:31.009049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] creating snapshot='volume-d811911f-7135-4822-aa2d-99ff0b4a1787.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:33:33.805235 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-d811911f-7135-4822-aa2d-99ff0b4a1787.clone_snap' to 'volume-d811911f-7135-4822-aa2d-99ff0b4a1787' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:33:36.765129 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:33:36.766379 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:33:36.766767 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:33:37.555674 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:33:37.556375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Marking volume d811911f-7135-4822-aa2d-99ff0b4a1787 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:33:37.574742 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:33:37.646737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to d811911f-7135-4822-aa2d-99ff0b4a1787. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:33:37.647273 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Creating volume glance metadata for volume d811911f-7135-4822-aa2d-99ff0b4a1787 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:33:37.795377 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e389dd9-8bd0-49bb-9e76-0ae3819462f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d811911f-7135-4822-aa2d-99ff0b4a1787', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704ae340>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:37.801973 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03782fd9-c211-46d9-9df7-4d3e95aa04e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:38.001058 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-d811911f-7135-4822-aa2d-99ff0b4a1787 (d811911f-7135-4822-aa2d-99ff0b4a1787): created successfully
Sep 06 11:33:38.004701 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03782fd9-c211-46d9-9df7-4d3e95aa04e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:38.010210 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (8642f0a7-e06a-4586-b2b5-c8ebbadde7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:38.108809 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-51b2b3d4-69c0-4a62-bcbc-d6430255d960 tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:33:40.050710 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f req-3551553f-f7bc-42f2-9bd4-160699c83af5 tempest-VolumesSnapshotTestJSON-1413768274 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:33:40.803678 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f req-3551553f-f7bc-42f2-9bd4-160699c83af5 tempest-VolumesSnapshotTestJSON-1413768274 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.753s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:33:40.804560 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f req-3551553f-f7bc-42f2-9bd4-160699c83af5 tempest-VolumesSnapshotTestJSON-1413768274 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d811911f-7135-4822-aa2d-99ff0b4a1787', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'd811911f-7135-4822-aa2d-99ff0b4a1787', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:33:40.959921 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f req-3551553f-f7bc-42f2-9bd4-160699c83af5 tempest-VolumesSnapshotTestJSON-1413768274 None] Connection info returned from driver {'name': 'volumes/volume-d811911f-7135-4822-aa2d-99ff0b4a1787', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd811911f-7135-4822-aa2d-99ff0b4a1787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '071ad617-737b-4532-b50b-f89206862775'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:33:41.114109 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-7920c8ff-291d-4ae1-ab95-19fad4fdb78f req-3551553f-f7bc-42f2-9bd4-160699c83af5 tempest-VolumesSnapshotTestJSON-1413768274 None] attachment_update completed successfully.
Sep 06 11:33:44.799901 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:33:44.820062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Flow 'volume_create_manager' (1a4fc60c-1809-4aa4-8e89-f347b2e61a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:44.826626 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9dba62-8c75-4e92-97b1-f50b1d1a1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:44.845963 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9dba62-8c75-4e92-97b1-f50b1d1a1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1543786938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc174731-f6bc-4262-89b0-d7a1ee57a3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde0aad9d4124125ad5e5ba2d27a25ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:33:45Z,use_quota=True,user_id='a47671316599430eb6b6446299f6e5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78ba6bd2-00e3-4d28-9f03-91644a5b003d),volume_type_id=78ba6bd2-00e3-4d28-9f03-91644a5b003d)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:44.851169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da1718-59b0-4f98-8de9-a5b05b4a5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:44.855300 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da1718-59b0-4f98-8de9-a5b05b4a5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:44.860836 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036b84e6-91e7-4047-8e90-25d04aca21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:44.865118 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036b84e6-91e7-4047-8e90-25d04aca21ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc174731-f6bc-4262-89b0-d7a1ee57a3c2', 'volume_name': 'volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:44.870106 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4391e-0cdb-4797-b6e1-9f3219261d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:44.874260 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4391e-0cdb-4797-b6e1-9f3219261d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:44.878914 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491be945-8827-48f9-8f63-be8de5e2aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:44.880175 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Volume dc174731-f6bc-4262-89b0-d7a1ee57a3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2', 'volume_size': 1}
Sep 06 11:33:44.880590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] creating volume 'volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:33:44.881572 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:45.184012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-00f79210-ba6e-4242-8e3b-2b15697fa426 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:45.927766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] extra_specs: {} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:33:45.928482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] extra_specs: {} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:33:45.934520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491be945-8827-48f9-8f63-be8de5e2aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:45.939775 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0219d18-83b7-421b-a916-11921a8228f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:33:46.020297 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Volume volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2 (dc174731-f6bc-4262-89b0-d7a1ee57a3c2): created successfully
Sep 06 11:33:46.024150 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0219d18-83b7-421b-a916-11921a8228f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:33:46.030515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Flow 'volume_create_manager' (1a4fc60c-1809-4aa4-8e89-f347b2e61a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:33:46.135787 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-20ac2bd1-1b4f-4d36-a418-bd9315261e18 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Created volume successfully.
Sep 06 11:33:47.823675 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-07774c33-185e-4132-a4c6-a5292a69e60c tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:47.866222 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-07774c33-185e-4132-a4c6-a5292a69e60c tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:47.893086 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-07774c33-185e-4132-a4c6-a5292a69e60c tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:33:47.897229 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-07774c33-185e-4132-a4c6-a5292a69e60c tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Retype volume completed successfully.
Sep 06 11:33:48.797778 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Acquiring lock "cinder-dc174731-f6bc-4262-89b0-d7a1ee57a3c2-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:33:48.806435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Lock "cinder-dc174731-f6bc-4262-89b0-d7a1ee57a3c2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:33:48.868750 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-00f79210-ba6e-4242-8e3b-2b15697fa426 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:33:48.921841 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:49.423277 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:33:49.424071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Volume volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:33:49.695490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] deleting rbd volume volume-dc174731-f6bc-4262-89b0-d7a1ee57a3c2 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:33:49.817632 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-3455d2be-6673-4df8-a208-40e55b641d89 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:52.543627 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=67,cinder:UPDATE=14,cinder:INSERT=18,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:33:52.734350 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3455d2be-6673-4df8-a208-40e55b641d89 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:33:54.231616 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1cb3b711-b334-427f-aba8-88a9cef78133 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:57.773340 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=65,cinder:UPDATE=13,cinder:DELETE=3,cinder:INSERT=19 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:33:57.777735 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:33:57.778570 ncdv-master-1 cinder-volume[133823]: WARNING cinder.quota [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 06 11:33:57.907973 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Created reservations ['da0df1b0-a5a3-4e73-bc37-466ae3a809eb', '259f4e72-245f-4504-992f-4424e1035583', 'a7c434bb-52dd-4b78-a89f-b3534d0fe384', '58dc6a45-ed8a-40af-8b98-c7256ac0fd26'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:33:58.061199 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1cb3b711-b334-427f-aba8-88a9cef78133 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:33:58.183487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:58.210730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:58.238387 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:33:58.242852 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Deleted volume successfully.
Sep 06 11:33:58.306065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-5aef26fc-4f24-4cf5-8ed0-22e73c0b3e13-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:33:58.315160 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-5aef26fc-4f24-4cf5-8ed0-22e73c0b3e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:33:58.316634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:33:58.665896 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-98c34e4d-88c9-4bb5-a950-4beed88c0397 tempest-VolumeRetypeWithoutMigrationTest-2048225047 None] Lock "cinder-dc174731-f6bc-4262-89b0-d7a1ee57a3c2-delete_volume" released by "delete_volume" :: held 9.859s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:02.853688 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:34:02.854383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:02.890752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:02.933924 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:03.996853 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Terminate volume connection completed successfully.
Sep 06 11:34:04.024986 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-d162df04-b97f-4e17-846b-746e309657d5 tempest-VolumesBackupsTest-639521729 None] Remove volume export completed successfully.
Sep 06 11:34:05.363813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Acquiring lock "cinder-9c493320-229d-4e12-a32f-aff0584e239e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:05.374142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Lock "cinder-9c493320-229d-4e12-a32f-aff0584e239e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:05.458135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:07.599556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Volume volume-9c493320-229d-4e12-a32f-aff0584e239e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:07.908893 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] deleting rbd volume volume-9c493320-229d-4e12-a32f-aff0584e239e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:07.915766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:34:07.934550 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Flow 'volume_create_manager' (a238fca1-3aa6-4d21-ba6e-bf55bfeb05c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:07.941454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0e8b6a-7806-44d1-8f43-b074bb8c5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:07.963144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0e8b6a-7806-44d1-8f43-b074bb8c5003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-894360952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b7db69e8-c9d8-47aa-a3cb-9d8263f20dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f04c1e1bd7648ff809cb435cbe8807d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:34:05Z,use_quota=True,user_id='992701a1595d4f3f92b8ef4b6ab8a451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:07.968487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06d804b-1dbc-48ce-83bb-4d8e322cced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:07.972563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06d804b-1dbc-48ce-83bb-4d8e322cced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:07.977723 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a55e628-7f67-41f8-823e-87c7293eab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:08.062412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a55e628-7f67-41f8-823e-87c7293eab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7db69e8-c9d8-47aa-a3cb-9d8263f20dff', 'volume_name': 'volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70488d60>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:08.067895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f569e644-bc58-4c7e-ac48-887240abf9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:08.072360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f569e644-bc58-4c7e-ac48-887240abf9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:08.076737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c61c9b-d07f-4161-a8a6-ee816e02cb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:08.077851 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Volume b7db69e8-c9d8-47aa-a3cb-9d8263f20dff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70488d60>}
Sep 06 11:34:08.079187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Cloning b7db69e8-c9d8-47aa-a3cb-9d8263f20dff from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:34:08.079939 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:08.093762 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:08.205816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 34, 8, 98033)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:34:08.206189 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:34:08.206607 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:34:08.210988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.123s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:08.212018 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:34:08.218278 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 34, 8, 215873)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:34:08.218712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:34:08.219165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:34:08.233574 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:08.387701 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] creating snapshot='volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:34:11.077497 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff.clone_snap' to 'volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:34:12.626298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:12.628272 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:34:12.633555 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:34:13.014745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:34:13.015478 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Marking volume b7db69e8-c9d8-47aa-a3cb-9d8263f20dff as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:34:13.108562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to b7db69e8-c9d8-47aa-a3cb-9d8263f20dff. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:34:13.109003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Creating volume glance metadata for volume b7db69e8-c9d8-47aa-a3cb-9d8263f20dff backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:34:13.232299 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c61c9b-d07f-4161-a8a6-ee816e02cb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70488d60>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:13.236757 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a25021-614e-4192-9603-1660b7e20e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:13.297199 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Volume volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff (b7db69e8-c9d8-47aa-a3cb-9d8263f20dff): created successfully
Sep 06 11:34:13.300898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a25021-614e-4192-9603-1660b7e20e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:13.306343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Flow 'volume_create_manager' (a238fca1-3aa6-4d21-ba6e-bf55bfeb05c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:13.388857 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-34a0ad39-2bf0-453f-a4a8-c096b9c2ddf1 tempest-VolumesImageMetadata-1006309368 None] Created volume successfully.
Sep 06 11:34:13.700569 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Created reservations ['94e96143-658a-4fe2-9c63-7ca947429194', '036dbd85-8c5c-4db6-808d-9279e171cc6e', 'e4edd11e-2421-4f97-a7ff-97de9d858d71', '5977c90c-487b-48f5-8919-c4eaf8b05406'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:13.792658 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=50,cinder:UPDATE=23,cinder:INSERT=25,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:34:13.928830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:13.954482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:14.017968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:14.023736 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Deleted volume successfully.
Sep 06 11:34:14.155872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ddbd15ca-1a43-438a-9f88-fc58b0ee7ffe tempest-VolumesBackupsTest-639521729 None] Lock "cinder-9c493320-229d-4e12-a32f-aff0584e239e-delete_volume" released by "delete_volume" :: held 8.750s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:14.427519 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Acquiring lock "cinder-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:14.428039 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Lock "cinder-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:14.523975 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:14.693928 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:34:14.816653 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] deleting rbd volume volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:18.892219 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:34:19.066331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] deleting parent snapshot volume-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:34:22.262626 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Created reservations ['4843f23b-256d-4f09-b9c3-aea98a470c94', 'c82e5d91-47f7-4156-8c66-887635a45095', '1e079c78-b6a9-496d-8694-152b9807fe92', '9f46a79f-8657-48c4-8691-11bc098ef793'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:22.434588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:22.464865 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:22.494966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:22.500103 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Deleted volume successfully.
Sep 06 11:34:22.575229 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-038617d0-fed3-4a99-a1e1-17e7bc2fc962 tempest-VolumesImageMetadata-1006309368 None] Lock "cinder-b7db69e8-c9d8-47aa-a3cb-9d8263f20dff-delete_volume" released by "delete_volume" :: held 8.148s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:23.485444 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Acquiring lock "cinder-bd21d98c-616b-4c7a-b954-b1a23411e049-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:23.491659 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-bd21d98c-616b-4c7a-b954-b1a23411e049-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:23.589239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:25.510173 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] deleting rbd volume volume-bd21d98c-616b-4c7a-b954-b1a23411e049 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:25.989888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:34:26.008628 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Flow 'volume_create_manager' (84c33265-209d-4c24-974a-f1d04a05aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:26.014848 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117dba2-7032-433d-bb1a-1efdfdd331b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.030945 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117dba2-7032-433d-bb1a-1efdfdd331b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1343377485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f3eefdf-e640-46b5-99c3-c37fa8b223a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7ba82fe2d044cbbdad652fc33aab67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:34:26Z,use_quota=True,user_id='de6d336036a7424c8deb563ecc49798a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.036789 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a5c36c-ba1e-427c-8d34-a51b22fdbf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.040842 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a5c36c-ba1e-427c-8d34-a51b22fdbf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.050948 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fab167-edf9-4620-b929-8fa80f62364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.050948 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fab167-edf9-4620-b929-8fa80f62364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3eefdf-e640-46b5-99c3-c37fa8b223a3', 'volume_name': 'volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.054295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c328d2-193b-4dc8-8908-91a084f9aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.058022 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c328d2-193b-4dc8-8908-91a084f9aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.063228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9e0454-8c1d-4c91-a744-ba1df325b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.064261 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Volume 4f3eefdf-e640-46b5-99c3-c37fa8b223a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3', 'volume_size': 1}
Sep 06 11:34:26.064649 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] creating volume 'volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:34:26.065463 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:26.639142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:34:26.639798 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:34:26.643321 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9e0454-8c1d-4c91-a744-ba1df325b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.647843 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feab30b-99f6-40b7-86b9-1bbe2a133eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:26.756974 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Volume volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3 (4f3eefdf-e640-46b5-99c3-c37fa8b223a3): created successfully
Sep 06 11:34:26.760643 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feab30b-99f6-40b7-86b9-1bbe2a133eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:26.766071 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Flow 'volume_create_manager' (84c33265-209d-4c24-974a-f1d04a05aee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:26.912520 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-28a11b0a-5345-4a65-bf3c-2615bbaa9c53 tempest-SnapshotMetadataTestJSON-1699649529 None] Created volume successfully.
Sep 06 11:34:28.375455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:34:28.526844 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] deleting parent snapshot volume-bd21d98c-616b-4c7a-b954-b1a23411e049.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:34:30.601647 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:DELETE=2,cinder:SELECT=57,cinder:UPDATE=25,cinder:INSERT=10 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:34:30.726135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Created reservations ['55229384-fa58-408b-a604-b15ec13c1a88', 'cd3c0f47-305f-4b0f-a005-5af6a79086ed', '7ec006e8-031a-479a-85fe-98ba0344a44a', '41a5e00e-09fd-4cc2-adc9-647c7aa73696'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:30.740969 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7bb7a703-f83a-487f-8c62-190c7d366dea tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:31.039630 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['bf5c7ad1-3607-41c9-b052-2de236c0e7f5', 'b13f7766-63a4-47db-aefa-8e79e6a9be6b', '84125618-b608-4a0e-9411-ed6680e92421', '14138163-cf45-4540-b29e-2e06d2532448'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:31.132371 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:31.156542 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:31.181059 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:31.186218 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Deleted volume successfully.
Sep 06 11:34:31.263771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-1a2649af-9266-4a73-b3e4-9544cd6ca3b8 tempest-VolumesBackupsTest-639521729 None] Lock "cinder-bd21d98c-616b-4c7a-b954-b1a23411e049-delete_volume" released by "delete_volume" :: held 7.772s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:31.294129 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:34:31.379750 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:34:31.384428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-96eb9b38-18bf-441b-afe1-a0fdbeafa9d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-5aef26fc-4f24-4cf5-8ed0-22e73c0b3e13-delete_snapshot" released by "delete_snapshot" :: held 33.069s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:32.442002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-444b6e36-10d7-4b4c-b865-a1ceefff1cec-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:32.461009 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-444b6e36-10d7-4b4c-b865-a1ceefff1cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:32.462510 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:33.528550 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7bb7a703-f83a-487f-8c62-190c7d366dea tempest-SnapshotMetadataTestJSON-1699649529 None] Create snapshot completed successfully
Sep 06 11:34:35.172254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:34:35.191512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Flow 'volume_create_manager' (b28961f6-fee2-43ec-8d4b-0d5a62278102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:35.197700 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b2afe6-501a-4e50-aad7-94974b80c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.213020 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b2afe6-501a-4e50-aad7-94974b80c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-368040222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbaed81c-8a5c-489b-af87-b7fc9486bc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ca499c5b634be39c2e11a47710355a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:34:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:34:35Z,use_quota=True,user_id='edfcc0981d364f7bbcb530a03e862844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.218140 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076509c7-3bbd-416d-9b88-b02b9a946d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.226835 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076509c7-3bbd-416d-9b88-b02b9a946d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.227619 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c43e4c-c0a6-42b5-a87f-10e1377d26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.231498 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c43e4c-c0a6-42b5-a87f-10e1377d26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbaed81c-8a5c-489b-af87-b7fc9486bc61', 'volume_name': 'volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61', 'volume_size': 2}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.236816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca57956-8d9e-4b9a-b0f0-b104994668fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.240607 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca57956-8d9e-4b9a-b0f0-b104994668fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.245103 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259664c-93a1-452d-897c-c25e398d44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.246134 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Volume bbaed81c-8a5c-489b-af87-b7fc9486bc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61', 'volume_size': 2}
Sep 06 11:34:35.246522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] creating volume 'volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:34:35.247301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:35.717161 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:34:35.717543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:34:35.721161 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259664c-93a1-452d-897c-c25e398d44e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61', 'volume_size': 2}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.725583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e942739d-22b9-48cc-be9f-601c7dacc077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:35.793669 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Volume volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61 (bbaed81c-8a5c-489b-af87-b7fc9486bc61): created successfully
Sep 06 11:34:35.797303 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e942739d-22b9-48cc-be9f-601c7dacc077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:35.803263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Flow 'volume_create_manager' (b28961f6-fee2-43ec-8d4b-0d5a62278102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:35.915732 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] Acquiring lock "cinder-724476f3-5063-4f6c-9120-a9f5fcb90e7e-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:35.923639 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0489bb86-9693-460c-9f5f-1a147c51b813 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Created volume successfully.
Sep 06 11:34:35.930628 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] Lock "cinder-724476f3-5063-4f6c-9120-a9f5fcb90e7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:35.932575 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:36.663570 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-a8f803ea-3661-4ffc-b9fb-75ad523237a0 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:38.133679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] Created reservations ['fbe402b1-1e2b-47bd-94c7-7b6f94c58353', '76fe357c-6250-450b-a7b1-1c6d177609f6', '0fcce796-9c5f-4939-bac2-98e152e489b6', '4974b234-8cca-449a-93be-cf51ea987053'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:38.296669 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] Delete snapshot completed successfully.
Sep 06 11:34:38.301332 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e221b237-211a-4e25-b409-6f05cef50d5d tempest-SnapshotMetadataTestJSON-1699649529 None] Lock "cinder-724476f3-5063-4f6c-9120-a9f5fcb90e7e-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:38.436610 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-a8f803ea-3661-4ffc-b9fb-75ad523237a0 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Create snapshot completed successfully
Sep 06 11:34:38.715899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Acquiring lock "cinder-baa3c3d1-0dd4-4f36-b5df-fc2c2fbbe989-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:38.725246 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Lock "cinder-baa3c3d1-0dd4-4f36-b5df-fc2c2fbbe989-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:38.729092 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:39.236281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Acquiring lock "cinder-4f3eefdf-e640-46b5-99c3-c37fa8b223a3-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:39.247435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Lock "cinder-4f3eefdf-e640-46b5-99c3-c37fa8b223a3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:39.360268 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:39.535429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:34:39.536158 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Volume volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:39.597026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] deleting rbd volume volume-4f3eefdf-e640-46b5-99c3-c37fa8b223a3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:41.276678 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Created reservations ['886c5149-7ee2-4a4d-a306-40603967be9a', '0564bebd-d278-4da6-bd29-0a506e22bc91', '605f6721-d8e3-447d-9270-574ef5b9b599', '0767ee58-6ca6-4b12-af99-c30fa13ac4f9'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:41.462045 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Delete snapshot completed successfully.
Sep 06 11:34:41.466728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7bdd6beb-24d4-43f6-8b5b-6539201c6661 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Lock "cinder-baa3c3d1-0dd4-4f36-b5df-fc2c2fbbe989-delete_snapshot" released by "delete_snapshot" :: held 2.742s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:42.014602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Acquiring lock "cinder-bbaed81c-8a5c-489b-af87-b7fc9486bc61-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:42.024270 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Lock "cinder-bbaed81c-8a5c-489b-af87-b7fc9486bc61-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:42.139782 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:42.304916 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:34:42.305541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Volume volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:42.403433 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] deleting rbd volume volume-bbaed81c-8a5c-489b-af87-b7fc9486bc61 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:42.851475 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Created reservations ['3c0d3ed8-5433-4c2a-b742-3d97d5ad5c87', '238e7f3c-ecc8-41e8-bcfa-7464658afb58', 'a9e9ba23-bc2d-4661-8181-bff3668fa290', 'f4719a0d-e1d4-437b-b099-4ce4506fbb72'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:43.071284 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:43.095777 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:43.133587 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:43.138053 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Deleted volume successfully.
Sep 06 11:34:43.215228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-08d9a62d-f102-46d3-a13b-af423cc4d401 tempest-SnapshotMetadataTestJSON-1699649529 None] Lock "cinder-4f3eefdf-e640-46b5-99c3-c37fa8b223a3-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:45.105522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Created reservations ['619cfe3f-090b-4cfe-b64e-61e466d33715', '7c6464bc-1428-4a5f-8491-1782a361fbac', 'bf237005-6aa0-4adc-baae-7ff2941419ee', 'aecbe24b-8c2d-4720-9d64-3784c83ee6da'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:45.211225 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:34:45.217943 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=53,cinder:DELETE=3,cinder:UPDATE=35,cinder:INSERT=9 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:34:45.291641 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:45.316603 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:45.345890 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:45.350078 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Deleted volume successfully.
Sep 06 11:34:45.521744 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-f98cde8e-a188-4dde-b643-30a351dca700 tempest-VolumesSnapshotNegativeTestJSON-1273568195 None] Lock "cinder-bbaed81c-8a5c-489b-af87-b7fc9486bc61-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:48.345219 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:34:48.365139 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Flow 'volume_create_manager' (3513c64d-7ce5-4aa7-af8c-c0aed9d2d5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:48.371565 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5e3f78-03de-485d-92b7-8ef52ec989e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.388257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5e3f78-03de-485d-92b7-8ef52ec989e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1076643211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885d773a019e4be7b5af2f254e0a5316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:34:48Z,use_quota=True,user_id='8491f673a7194278a76280aa9b61648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.393532 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada1936-2d62-4737-8a55-7da86dca644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.397608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada1936-2d62-4737-8a55-7da86dca644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.402988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e28e32-b83c-4186-8d90-53bcae508b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.407102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e28e32-b83c-4186-8d90-53bcae508b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0', 'volume_name': 'volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.411888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d925c2-45b3-425f-a494-d3b98fcdea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.415749 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d925c2-45b3-425f-a494-d3b98fcdea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.420349 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cc6f77-30e8-4e94-8d07-b127111a5ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.423542 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Volume 4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0', 'volume_size': 1}
Sep 06 11:34:48.423542 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] creating volume 'volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:34:48.423542 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:48.913181 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:34:48.913598 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:34:48.917689 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cc6f77-30e8-4e94-8d07-b127111a5ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.923756 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34b78dc-fb8e-4702-9208-a98b3ae95c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:48.987709 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Volume volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0 (4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0): created successfully
Sep 06 11:34:48.991256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34b78dc-fb8e-4702-9208-a98b3ae95c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:48.996501 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Flow 'volume_create_manager' (3513c64d-7ce5-4aa7-af8c-c0aed9d2d5b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:49.056239 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-103eeed1-46d5-4aa5-bdb4-6c77898ecf5f tempest-VolumesTransfersTest-486848475 None] Created volume successfully.
Sep 06 11:34:50.316405 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-3d73c7b6-1b71-439b-be7d-f6bb3d1a351a tempest-VolumesTransfersTest-1530242136 None] Transfer volume completed successfully.
Sep 06 11:34:51.476864 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Acquiring lock "cinder-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:51.491615 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Lock "cinder-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:51.618318 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:51.779291 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:34:51.779753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Volume volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:51.842949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] deleting rbd volume volume-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:34:54.444898 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Created reservations ['9b0c0455-9025-4656-a7aa-a610454a6480', '4e3b967c-5c77-45b7-be2a-babaa524e53f', '8ad7c7e6-ac4d-4e08-97f8-447205695dc3', 'cf02bbbb-6121-485f-8d53-f83b46fff959'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:34:54.628624 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:54.662929 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:54.699443 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:34:54.704676 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Deleted volume successfully.
Sep 06 11:34:54.827766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-28a14a04-74d6-4eb1-9a16-33ee7bd2c405 tempest-VolumesTransfersTest-1561452170 None] Lock "cinder-4fcb8cf9-4953-49ad-8f20-17ef6f6e4bb0-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:34:55.578102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:34:55.598438 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Flow 'volume_create_manager' (ff302dd3-61e7-448d-a81c-e160320bd2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:55.604826 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389cc4fc-3fef-48b6-a76f-1c93ccf1585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:55.622145 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389cc4fc-3fef-48b6-a76f-1c93ccf1585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2140890956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be8ddf5d-862e-45bd-b6da-3c88282b9cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885d773a019e4be7b5af2f254e0a5316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:34:55Z,use_quota=True,user_id='8491f673a7194278a76280aa9b61648c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:55.627681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f77ad5-3276-4812-bfb5-4e8b107a776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:55.631860 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f77ad5-3276-4812-bfb5-4e8b107a776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:55.637099 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34844536-16ac-464b-817f-3f197929ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:55.641651 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34844536-16ac-464b-817f-3f197929ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8ddf5d-862e-45bd-b6da-3c88282b9cf1', 'volume_name': 'volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:55.646595 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fe0922-96e7-4a5e-9097-1e077366a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:55.650625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fe0922-96e7-4a5e-9097-1e077366a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:55.655558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bba082-67e9-455e-9dad-d8567fb236c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:55.660885 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Volume be8ddf5d-862e-45bd-b6da-3c88282b9cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1', 'volume_size': 1}
Sep 06 11:34:55.660885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] creating volume 'volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:34:55.660885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:56.137182 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:34:56.137651 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:34:56.142102 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bba082-67e9-455e-9dad-d8567fb236c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:56.146675 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991beb86-630a-4062-b346-805f725f3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:34:56.241976 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Volume volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1 (be8ddf5d-862e-45bd-b6da-3c88282b9cf1): created successfully
Sep 06 11:34:56.245719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991beb86-630a-4062-b346-805f725f3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:34:56.251736 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Flow 'volume_create_manager' (ff302dd3-61e7-448d-a81c-e160320bd2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:34:56.352524 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-779aa75d-b2c7-486d-a3f9-71e07a0f7ee1 tempest-VolumesTransfersTest-486848475 None] Created volume successfully.
Sep 06 11:34:57.119310 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Acquiring lock "cinder-be8ddf5d-862e-45bd-b6da-3c88282b9cf1-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:34:57.138002 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Lock "cinder-be8ddf5d-862e-45bd-b6da-3c88282b9cf1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:34:57.245020 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:34:57.438824 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:34:57.439067 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Volume volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:34:57.551322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] deleting rbd volume volume-be8ddf5d-862e-45bd-b6da-3c88282b9cf1 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:00.645381 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Created reservations ['70263e31-8d78-4f70-bf06-9448101d441f', 'a0baf6f4-47d3-4b79-862d-3ca2e764a27c', 'b38374d4-6969-4c01-80c6-d2e6e933168d', '85009d79-0eb3-47ca-bdbb-5f56c22b7296'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:00.828830 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:00.875485 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:00.944786 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:00.952320 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Deleted volume successfully.
Sep 06 11:35:01.032141 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0bc75f73-170d-4e93-94ea-d36cfa69ea68 tempest-VolumesTransfersTest-1561452170 None] Lock "cinder-be8ddf5d-862e-45bd-b6da-3c88282b9cf1-delete_volume" released by "delete_volume" :: held 3.894s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:02.856433 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:35:02.858050 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:02.994599 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:03.034259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:03.473494 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['05ef5dd9-004d-4849-bf4c-fe9a61a638e1', '23cba57b-3e9b-4640-ad3b-07e8aca51095', '02ddbdba-a306-4685-9cdf-e5e7d01f93fb', '98112dea-18f3-4996-8794-f640cf537f2d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:03.776518 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:35:03.783035 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-21c300c2-7476-478c-9a58-489b05bbf220 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-444b6e36-10d7-4b4c-b865-a1ceefff1cec-delete_snapshot" released by "delete_snapshot" :: held 31.322s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:04.656978 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-7c90082f-cd50-48ac-b434-832b8db6092f-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:04.666686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-7c90082f-cd50-48ac-b434-832b8db6092f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:04.668576 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:07.726483 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:07.747298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (a66f5c78-822a-40c0-9bee-2247fe27e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:07.754680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf5e0f6-b49d-454b-9fc8-33462aa7566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:07.771634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf5e0f6-b49d-454b-9fc8-33462aa7566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-204552767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f568595-95cd-4640-b235-4b4edb08fbcb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:07Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:07.776938 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bced202-9e1d-4192-9727-2d66734276dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:07.781360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bced202-9e1d-4192-9727-2d66734276dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:07.786326 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f23952-599e-4677-9bc1-f49bfd964aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:07.790266 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f23952-599e-4677-9bc1-f49bfd964aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f568595-95cd-4640-b235-4b4edb08fbcb', 'volume_name': 'volume-5f568595-95cd-4640-b235-4b4edb08fbcb', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:07.795030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1772e8-15c9-47f3-a83a-85add7bd971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:07.799325 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1772e8-15c9-47f3-a83a-85add7bd971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:07.804033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f786b-7c72-4f84-883d-494277be00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:07.805072 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Volume 5f568595-95cd-4640-b235-4b4edb08fbcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f568595-95cd-4640-b235-4b4edb08fbcb', 'volume_size': 1}
Sep 06 11:35:07.805456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] creating volume 'volume-5f568595-95cd-4640-b235-4b4edb08fbcb' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:35:07.806223 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:08.271707 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:08.272247 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:08.276256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f786b-7c72-4f84-883d-494277be00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f568595-95cd-4640-b235-4b4edb08fbcb', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:08.281522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c520369e-ce77-4e71-9294-d6cecdd46bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:08.359691 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Volume volume-5f568595-95cd-4640-b235-4b4edb08fbcb (5f568595-95cd-4640-b235-4b4edb08fbcb): created successfully
Sep 06 11:35:08.367787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c520369e-ce77-4e71-9294-d6cecdd46bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:08.373177 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (a66f5c78-822a-40c0-9bee-2247fe27e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:08.465711 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9c110404-1f54-4bfb-aa99-d8dba6979a2d tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:09.737725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:09.756410 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (f52291c4-611f-4428-a538-1228d8dbd9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:09.762591 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ce49f-acd9-43d7-8cf8-8608c97d64e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:09.778770 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ce49f-acd9-43d7-8cf8-8608c97d64e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-265817236',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ce1fb71-dfd9-4c57-ab48-c041b257ca91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:10Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:09.785825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371a7945-8c73-4d6e-8f16-c80577806630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:09.790012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371a7945-8c73-4d6e-8f16-c80577806630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:09.795069 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3636a7-921a-40d3-bbb4-2148d3dca53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:09.799731 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3636a7-921a-40d3-bbb4-2148d3dca53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce1fb71-dfd9-4c57-ab48-c041b257ca91', 'volume_name': 'volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:09.804636 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e21423-5e7e-403e-90e3-1a0d116c5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:09.808419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e21423-5e7e-403e-90e3-1a0d116c5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:09.812955 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7970256-0439-48bd-bfbd-65452f249a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:09.813996 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Volume 7ce1fb71-dfd9-4c57-ab48-c041b257ca91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91', 'volume_size': 1}
Sep 06 11:35:09.814384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] creating volume 'volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:35:09.815044 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:10.205980 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:10.206385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:10.210248 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7970256-0439-48bd-bfbd-65452f249a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:10.214802 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f0ab2d-fa7e-4235-962d-3163a8c20d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:10.293230 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Volume volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91 (7ce1fb71-dfd9-4c57-ab48-c041b257ca91): created successfully
Sep 06 11:35:10.297003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f0ab2d-fa7e-4235-962d-3163a8c20d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:10.302504 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (f52291c4-611f-4428-a538-1228d8dbd9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:10.306694 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:DELETE=5,cinder:UPDATE=32,cinder:INSERT=6 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:10.439367 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b4cf252c-7c42-4a96-8b21-ed4f5bfe1fc4 tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:10.932544 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-7ce1fb71-dfd9-4c57-ab48-c041b257ca91-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:10.944930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Lock "cinder-7ce1fb71-dfd9-4c57-ab48-c041b257ca91-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:11.110966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:11.247204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:11.247557 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Volume volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:11.304728 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-7ce1fb71-dfd9-4c57-ab48-c041b257ca91 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:13.924927 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Created reservations ['c770dffe-d9c3-489a-af8d-92977ac6412d', '4e9e0d77-ffa1-463d-b328-c44a357613d2', '62b2b4ff-194e-45e8-a61c-7f4dd9f2b42d', '1e7a7823-8880-4591-bb13-97e0ff86ca16'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:14.032068 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=31,cinder:SELECT=60,cinder:DELETE=2,cinder:INSERT=7 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:14.128058 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:14.170531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:14.201578 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:14.209148 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:14.291869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-ea64f874-9f36-45d4-af2a-355703c5e234 tempest-VolumesGetTest-1617451306 None] Lock "cinder-7ce1fb71-dfd9-4c57-ab48-c041b257ca91-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:14.347671 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-5f568595-95cd-4640-b235-4b4edb08fbcb-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:14.359232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Lock "cinder-5f568595-95cd-4640-b235-4b4edb08fbcb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:14.465977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:14.584709 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:14.585237 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Volume volume-5f568595-95cd-4640-b235-4b4edb08fbcb is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:14.679263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-5f568595-95cd-4640-b235-4b4edb08fbcb {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:17.292956 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Created reservations ['d25467c2-4cce-434e-98cc-a0535d28e497', 'b8210aaa-0f08-4d50-9057-c815d8ca0df8', 'a01a54e9-498f-4cff-8b67-d33f2cbbb50a', '66c64fd8-2b66-4fcf-849e-9720d9734be5'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:17.493406 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:17.565129 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:17.595995 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:17.601620 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:17.706612 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-74e5247f-88d1-4986-bb6a-9ed8a814e7e8 tempest-VolumesGetTest-1617451306 None] Lock "cinder-5f568595-95cd-4640-b235-4b4edb08fbcb-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:18.383125 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:18.402360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (b3a724dc-1738-4b11-82e4-51ed155fc25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:18.409806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a6c12a-4781-45ab-b110-437a1e75c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.426094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a6c12a-4781-45ab-b110-437a1e75c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-130640018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e96c9b3d-2327-4806-b915-32f684bbb89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:18Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.431290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b51298-e09c-474a-a081-9e2bdaa55ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.435285 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b51298-e09c-474a-a081-9e2bdaa55ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.440912 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cb9410-f52a-4a58-add2-cbb42b93328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.444945 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cb9410-f52a-4a58-add2-cbb42b93328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96c9b3d-2327-4806-b915-32f684bbb89e', 'volume_name': 'volume-e96c9b3d-2327-4806-b915-32f684bbb89e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.449678 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0364acc-1e15-46e8-9bb2-a0ea51c8ac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.453613 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0364acc-1e15-46e8-9bb2-a0ea51c8ac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.458257 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acd2db7-c0f7-40f9-aa7f-3db6fb42f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.459333 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Volume e96c9b3d-2327-4806-b915-32f684bbb89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96c9b3d-2327-4806-b915-32f684bbb89e', 'volume_size': 1}
Sep 06 11:35:18.459729 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] creating volume 'volume-e96c9b3d-2327-4806-b915-32f684bbb89e' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:35:18.460492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:18.915642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:18.916029 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:18.919724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acd2db7-c0f7-40f9-aa7f-3db6fb42f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96c9b3d-2327-4806-b915-32f684bbb89e', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.924757 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cc5102-f250-4c5e-bbd6-83d0ebe1ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:18.987198 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Volume volume-e96c9b3d-2327-4806-b915-32f684bbb89e (e96c9b3d-2327-4806-b915-32f684bbb89e): created successfully
Sep 06 11:35:18.990727 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cc5102-f250-4c5e-bbd6-83d0ebe1ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:18.995993 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (b3a724dc-1738-4b11-82e4-51ed155fc25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:19.064422 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fb2ed48f-b3ca-4a18-a882-151ae19797f6 tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:20.297365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:20.324631 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (64715fd1-6960-4a6c-a6b6-ce813cccc24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:20.331555 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178d72b7-ed27-4890-8e3c-8b0a0076b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:20.347341 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178d72b7-ed27-4890-8e3c-8b0a0076b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-574519288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=634e6d15-a982-4b67-8ae1-0fee3491e785,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e96c9b3d-2327-4806-b915-32f684bbb89e,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:20Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:20.352642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f523627-7927-4ab8-b636-c8905cccdaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:20.356795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f523627-7927-4ab8-b636-c8905cccdaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:20.361706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d687e8-34c7-435e-a89a-d0160a663886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:20.383425 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d687e8-34c7-435e-a89a-d0160a663886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '634e6d15-a982-4b67-8ae1-0fee3491e785', 'volume_name': 'volume-634e6d15-a982-4b67-8ae1-0fee3491e785', 'volume_size': 1, 'source_volid': 'e96c9b3d-2327-4806-b915-32f684bbb89e', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:20.388331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fb2f76-a523-4cf3-a480-bf45a1d52954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:20.392845 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fb2f76-a523-4cf3-a480-bf45a1d52954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:20.398310 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779393d0-f8f6-42c0-8bc7-93c5c85ee558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:20.399404 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Volume 634e6d15-a982-4b67-8ae1-0fee3491e785: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-634e6d15-a982-4b67-8ae1-0fee3491e785', 'volume_size': 1, 'source_volid': 'e96c9b3d-2327-4806-b915-32f684bbb89e', 'source_volstatus': 'available'}
Sep 06 11:35:20.411938 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:20.544041 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] creating snapshot='volume-634e6d15-a982-4b67-8ae1-0fee3491e785.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:35:22.476420 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] cloning 'volume-e96c9b3d-2327-4806-b915-32f684bbb89e@volume-634e6d15-a982-4b67-8ae1-0fee3491e785.clone_snap' to 'volume-634e6d15-a982-4b67-8ae1-0fee3491e785' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:35:23.348644 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Volume volume-e96c9b3d-2327-4806-b915-32f684bbb89e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:23.349897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:23.350282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:23.533689 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:35:23.537507 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779393d0-f8f6-42c0-8bc7-93c5c85ee558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634e6d15-a982-4b67-8ae1-0fee3491e785', 'volume_size': 1, 'source_volid': 'e96c9b3d-2327-4806-b915-32f684bbb89e', 'source_volstatus': 'available'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:23.541999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c631f9b-fbe9-4ba9-830e-580064373d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:23.610164 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Volume volume-634e6d15-a982-4b67-8ae1-0fee3491e785 (634e6d15-a982-4b67-8ae1-0fee3491e785): created successfully
Sep 06 11:35:23.613780 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c631f9b-fbe9-4ba9-830e-580064373d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:23.619139 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (64715fd1-6960-4a6c-a6b6-ce813cccc24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:23.690611 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-376c2b44-ce73-455d-914c-8232e0578a29 tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:25.434524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:25.454433 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (bad46751-b855-4a02-8888-15640e6a26ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:25.460732 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b52fc6d-262a-4033-9933-198b1b1f9c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:25.476816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b52fc6d-262a-4033-9933-198b1b1f9c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-409858281',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=49d37e1c-a538-470a-97bb-2d3659171437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:25Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:25.482239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8d1afc-cc50-44f2-b130-5f3d68d3d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:25.486650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8d1afc-cc50-44f2-b130-5f3d68d3d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:25.492650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3119fdd7-dd9b-4337-82da-6faa65c5bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:25.496722 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3119fdd7-dd9b-4337-82da-6faa65c5bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d37e1c-a538-470a-97bb-2d3659171437', 'volume_name': 'volume-49d37e1c-a538-470a-97bb-2d3659171437', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:25.502095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31afe11-d0fb-43f2-88e7-8e12b429047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:25.505933 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31afe11-d0fb-43f2-88e7-8e12b429047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:25.510520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b120cf1e-6b18-46e6-8321-10a53c228d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:25.511635 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Volume 49d37e1c-a538-470a-97bb-2d3659171437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d37e1c-a538-470a-97bb-2d3659171437', 'volume_size': 1}
Sep 06 11:35:25.512006 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] creating volume 'volume-49d37e1c-a538-470a-97bb-2d3659171437' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:35:25.512655 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:26.087954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:26.088366 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:26.091987 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b120cf1e-6b18-46e6-8321-10a53c228d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d37e1c-a538-470a-97bb-2d3659171437', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:26.096988 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f1900a-f362-46ca-9ac9-754ad5f4ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:26.170623 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Volume volume-49d37e1c-a538-470a-97bb-2d3659171437 (49d37e1c-a538-470a-97bb-2d3659171437): created successfully
Sep 06 11:35:26.174787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f1900a-f362-46ca-9ac9-754ad5f4ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:26.180169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (bad46751-b855-4a02-8888-15640e6a26ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:26.250562 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-519e4936-efb3-42e9-856b-d77cfed6109d tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:26.559902 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-49d37e1c-a538-470a-97bb-2d3659171437-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:26.569803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Lock "cinder-49d37e1c-a538-470a-97bb-2d3659171437-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:26.662355 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:26.767167 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:26.767594 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Volume volume-49d37e1c-a538-470a-97bb-2d3659171437 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:26.841386 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-49d37e1c-a538-470a-97bb-2d3659171437 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:29.096405 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Created reservations ['5c6a4613-7857-42fe-896d-88c31bda0671', 'b01e1709-74c8-4675-a05d-7e0a1102590a', 'fdaae9b9-6d42-44a2-97c1-7396477cb345', 'f3e3eb90-69e6-4735-b2bb-76a9598c196b'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:29.203848 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:29.331062 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:29.354906 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:29.379977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:29.385357 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:29.463026 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2beebb37-1e66-4e67-a737-e1530672a588 tempest-VolumesGetTest-1617451306 None] Lock "cinder-49d37e1c-a538-470a-97bb-2d3659171437-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:30.006072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-634e6d15-a982-4b67-8ae1-0fee3491e785-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:30.018575 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Lock "cinder-634e6d15-a982-4b67-8ae1-0fee3491e785-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:30.116855 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:30.267155 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:30.322344 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-634e6d15-a982-4b67-8ae1-0fee3491e785 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:32.762522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:35:32.831078 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Volume volume-e96c9b3d-2327-4806-b915-32f684bbb89e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:32.831582 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] deleting parent snapshot volume-634e6d15-a982-4b67-8ae1-0fee3491e785.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:35:34.210886 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Created reservations ['bd6117e1-a3e2-491d-b86d-6940b5052041', '7764de87-47f9-4cea-be3f-93b1d59b229e', '51920106-c655-411b-b4b7-fdcd848155c5', 'c73ba719-985e-4379-9a2d-38cc1f037238'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:34.384700 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:34.409263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:34.434413 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:34.440319 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:34.525541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e76593b9-25ff-4658-a4c2-982e88b1c1e3 tempest-VolumesGetTest-1617451306 None] Lock "cinder-634e6d15-a982-4b67-8ae1-0fee3491e785-delete_volume" released by "delete_volume" :: held 4.508s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:35.393932 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['f982e143-0df7-4efe-af94-445c99ef719f', '218d0220-59c5-45b4-a72d-62bd5c3d81ad', 'b4eebe29-af34-42f3-bea8-0fa2e6aa52e8', '0f0226cc-3b2d-4878-beee-062952fc88f2'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:35.575333 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:35.676095 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:35:35.685302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-61c61ea8-8dbf-46bf-bf3e-7bf9293dde19 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-7c90082f-cd50-48ac-b434-832b8db6092f-delete_snapshot" released by "delete_snapshot" :: held 31.016s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:36.536917 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:36.555887 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (511cae2f-ded6-450e-8acc-069e0f099500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:36.562204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7378fa12-b2b1-454b-bd65-f09baeb8fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:36.578922 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7378fa12-b2b1-454b-bd65-f09baeb8fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-706743386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbd59767-97f3-43de-ba83-8f87569d356b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:36Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:36.584696 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d53821a-ee42-4a38-833d-0afb177416fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:36.588753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d53821a-ee42-4a38-833d-0afb177416fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:36.593708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2008e5e7-46a8-45f4-b9e2-a8f78a25c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:36.678725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2008e5e7-46a8-45f4-b9e2-a8f78a25c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fbd59767-97f3-43de-ba83-8f87569d356b', 'volume_name': 'volume-fbd59767-97f3-43de-ba83-8f87569d356b', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704181f0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:36.683206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb33ce9-e388-4387-8905-031131745fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:36.686986 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb33ce9-e388-4387-8905-031131745fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:36.692174 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af2e3d-e3bd-4f32-92a9-700373395eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:36.693258 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Volume fbd59767-97f3-43de-ba83-8f87569d356b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fbd59767-97f3-43de-ba83-8f87569d356b', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704181f0>}
Sep 06 11:35:36.693823 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Cloning fbd59767-97f3-43de-ba83-8f87569d356b from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:35:36.694546 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:36.702435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:36.766373 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-818311d0-bf87-41f0-b4ad-67ff1e442bff req-068d37bd-483b-4968-b2fe-88e4c3139842 tempest-VolumesSnapshotTestJSON-1413768274 None] Terminate volume connection completed successfully.
Sep 06 11:35:36.766782 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-818311d0-bf87-41f0-b4ad-67ff1e442bff req-068d37bd-483b-4968-b2fe-88e4c3139842 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleting attachment 071ad617-737b-4532-b50b-f89206862775. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:35:36.804403 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 35, 36, 707151)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:35:36.804831 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:35:36.805280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:35:36.809649 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.107s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:36.810565 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:35:36.816773 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 35, 36, 814276)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:35:36.817193 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:35:36.817592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:35:36.832135 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:37.007100 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] creating snapshot='volume-fbd59767-97f3-43de-ba83-8f87569d356b.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:35:39.021717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-fbd59767-97f3-43de-ba83-8f87569d356b.clone_snap' to 'volume-fbd59767-97f3-43de-ba83-8f87569d356b' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:35:39.799942 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:39.801331 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:39.801733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:40.100612 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:35:40.101274 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Marking volume fbd59767-97f3-43de-ba83-8f87569d356b as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:35:40.155030 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to fbd59767-97f3-43de-ba83-8f87569d356b. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:35:40.155458 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Creating volume glance metadata for volume fbd59767-97f3-43de-ba83-8f87569d356b backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:35:40.285232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af2e3d-e3bd-4f32-92a9-700373395eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd59767-97f3-43de-ba83-8f87569d356b', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a704181f0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:40.289949 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca277809-da04-4220-94c8-17d6eb5e3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:40.375563 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Volume volume-fbd59767-97f3-43de-ba83-8f87569d356b (fbd59767-97f3-43de-ba83-8f87569d356b): created successfully
Sep 06 11:35:40.379468 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca277809-da04-4220-94c8-17d6eb5e3942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:40.384863 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (511cae2f-ded6-450e-8acc-069e0f099500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:40.461206 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-15d9fe08-cc56-4492-9efa-c273a88aec41 tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:41.819303 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-933b2e97-f28c-4625-b995-4168b2231242 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:42.108558 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:35:42.127196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (112e0a0c-fe25-4f98-83c5-7fb7e4e493df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:42.133346 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bf05a3-c062-4b77-8ae1-6483caec5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.150242 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bf05a3-c062-4b77-8ae1-6483caec5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:35:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-226144275',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b7fbe9af-842b-46ca-a2b3-a63ccd386891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a724139144d89943edb4fe314d503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:35:42Z,use_quota=True,user_id='c279952b2ec548e582e0a3135f244541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.155721 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca333d73-c77e-469a-80cc-80448b3cbbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.160446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca333d73-c77e-469a-80cc-80448b3cbbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.165429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b974f09-af75-4ef4-aff8-d19026dd709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.169424 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b974f09-af75-4ef4-aff8-d19026dd709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fbe9af-842b-46ca-a2b3-a63ccd386891', 'volume_name': 'volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.174719 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa24ea0e-5f43-4f0e-b5b3-90d5997d9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.178512 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa24ea0e-5f43-4f0e-b5b3-90d5997d9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.183053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df63bc4b-d2b0-4e09-aff8-4b6c0f7d76ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.184106 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Volume b7fbe9af-842b-46ca-a2b3-a63ccd386891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891', 'volume_size': 1}
Sep 06 11:35:42.184496 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] creating volume 'volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:35:42.185251 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:42.604301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:35:42.604691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:35:42.608730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df63bc4b-d2b0-4e09-aff8-4b6c0f7d76ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.614680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b96e6c-bfc5-4d7a-8a5f-b02158b4df40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:35:42.718620 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Volume volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891 (b7fbe9af-842b-46ca-a2b3-a63ccd386891): created successfully
Sep 06 11:35:42.722782 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b96e6c-bfc5-4d7a-8a5f-b02158b4df40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:35:42.728349 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Flow 'volume_create_manager' (112e0a0c-fe25-4f98-83c5-7fb7e4e493df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:35:42.823729 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fba67fa7-6862-4f04-aecd-25457656fee2 tempest-VolumesGetTest-1617451306 None] Created volume successfully.
Sep 06 11:35:44.128053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-b7fbe9af-842b-46ca-a2b3-a63ccd386891-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:44.139396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Lock "cinder-b7fbe9af-842b-46ca-a2b3-a63ccd386891-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:44.251146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:44.393235 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:44.393553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Volume volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:44.521770 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-b7fbe9af-842b-46ca-a2b3-a63ccd386891 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:44.650788 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-933b2e97-f28c-4625-b995-4168b2231242 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:35:45.060746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-8173a945-ecf1-4328-a2c7-1eadea57ca09-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:45.070561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-8173a945-ecf1-4328-a2c7-1eadea57ca09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:45.072003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:48.207457 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=57,cinder:INSERT=13,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:48.397454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['dd2a3a82-b5a8-45f8-9b75-171fa0cc08d0', 'adef4cfb-de64-4c52-adae-50b2f907fda8', 'e5a4693a-0f8e-41ad-af78-dc534fa04172', 'f6d657fd-6fac-43df-8b2a-7cc1f66556f5'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:48.615064 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Created reservations ['859a5cb1-c13c-4e73-8121-335043d37bcb', '57901a0d-d937-4b02-98fa-2a09106747cc', 'b501994c-0646-48a9-b1c8-4e378248db84', 'b1356667-e014-4da7-84f7-9a4841e0dc0d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:48.782962 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:35:48.791881 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0c9c9d4d-60a2-41f5-95d8-d1d487f83ad7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-8173a945-ecf1-4328-a2c7-1eadea57ca09-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:48.890806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:48.919560 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:48.954748 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:48.959853 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:49.080095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-b7dc5e50-f642-4033-a581-3c7c6173234b tempest-VolumesGetTest-1617451306 None] Lock "cinder-b7fbe9af-842b-46ca-a2b3-a63ccd386891-delete_volume" released by "delete_volume" :: held 4.943s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:49.748118 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-fbd59767-97f3-43de-ba83-8f87569d356b-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:49.757720 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Lock "cinder-fbd59767-97f3-43de-ba83-8f87569d356b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:49.768231 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=58,cinder:UPDATE=27,cinder:INSERT=12,cinder:DELETE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:35:49.959515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:50.203874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:50.366563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-fbd59767-97f3-43de-ba83-8f87569d356b {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:50.383205 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e39c582f-79b2-4f61-9c94-129d3373afff tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:53.392691 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e39c582f-79b2-4f61-9c94-129d3373afff tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:35:54.013981 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:35:54.099583 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] deleting parent snapshot volume-fbd59767-97f3-43de-ba83-8f87569d356b.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:35:55.663803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Created reservations ['5e4d07d7-f5b5-44f6-bd70-2a6374028beb', '7c5610a6-92ba-4cac-9783-42e725d26cd8', '0a61cf35-4f37-4d3d-9bd6-5468d7c3295b', 'bf2dabda-8bdc-402c-b6d3-d08791d4446d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:55.964814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:56.058478 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:56.116214 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:56.120607 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:56.214083 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aefbb512-b0ff-4097-bd4e-43b5f009c430 tempest-VolumesGetTest-1617451306 None] Lock "cinder-fbd59767-97f3-43de-ba83-8f87569d356b-delete_volume" released by "delete_volume" :: held 6.456s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:35:56.415204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Acquiring lock "cinder-e96c9b3d-2327-4806-b915-32f684bbb89e-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:35:56.425033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Lock "cinder-e96c9b3d-2327-4806-b915-32f684bbb89e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:35:56.521298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:56.609560 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:35:56.609999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Volume volume-e96c9b3d-2327-4806-b915-32f684bbb89e is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:35:56.708086 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] deleting rbd volume volume-e96c9b3d-2327-4806-b915-32f684bbb89e {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:35:59.252268 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Created reservations ['59e8e040-3d35-4c8a-814a-6d667e9f1c6b', '6d687829-0d2c-4c0a-aacf-82463102edbc', '5d86dc52-6d19-4121-aca1-f2379d4d4e51', '7ce8201b-ce3c-4327-af8f-8943659e2aa9'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:35:59.441607 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:59.471285 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:35:59.500717 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:35:59.505313 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Deleted volume successfully.
Sep 06 11:35:59.571890 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fb73a713-8adb-4ea7-b9d1-5e5f38e38cfc tempest-VolumesGetTest-1617451306 None] Lock "cinder-e96c9b3d-2327-4806-b915-32f684bbb89e-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:36:02.851451 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:36:02.852543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:36:02.888691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:36:02.919142 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:36:08.718490 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ad363b52-9eaf-4920-baf8-9d44fb970678 req-01899b15-b562-44eb-b71f-6794323dc00b tempest-VolumesSnapshotTestJSON-1413768274 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:36:09.972377 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ad363b52-9eaf-4920-baf8-9d44fb970678 req-01899b15-b562-44eb-b71f-6794323dc00b tempest-VolumesSnapshotTestJSON-1413768274 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.253s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:36:09.973354 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ad363b52-9eaf-4920-baf8-9d44fb970678 req-01899b15-b562-44eb-b71f-6794323dc00b tempest-VolumesSnapshotTestJSON-1413768274 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-19567f19-1cb2-4e80-bf09-e8c419539694', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '19567f19-1cb2-4e80-bf09-e8c419539694', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:36:10.075379 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ad363b52-9eaf-4920-baf8-9d44fb970678 req-01899b15-b562-44eb-b71f-6794323dc00b tempest-VolumesSnapshotTestJSON-1413768274 None] Connection info returned from driver {'name': 'volumes/volume-19567f19-1cb2-4e80-bf09-e8c419539694', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '19567f19-1cb2-4e80-bf09-e8c419539694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9eac27ac-84be-47dd-906c-51cda66b6da1'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:36:10.228307 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-ad363b52-9eaf-4920-baf8-9d44fb970678 req-01899b15-b562-44eb-b71f-6794323dc00b tempest-VolumesSnapshotTestJSON-1413768274 None] attachment_update completed successfully.
Sep 06 11:36:13.665165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-6a02d90f-6814-452a-a2e5-7aa84be5bfda tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:36:15.404295 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-6a02d90f-6814-452a-a2e5-7aa84be5bfda tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:36:16.171564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ddeadc7c-d3a6-4668-83b8-1c07db2b5872 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:36:18.659595 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=60,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:36:18.783286 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ddeadc7c-d3a6-4668-83b8-1c07db2b5872 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:36:19.165037 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-5b49223d-1570-452d-9d2f-41d894df91cb-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:36:19.179680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-5b49223d-1570-452d-9d2f-41d894df91cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:36:19.181803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:36:29.044621 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=50,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:36:49.058948 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:36:50.040265 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['40f87420-2e1b-4609-97ed-1d872eb97b4b', 'd5889490-d535-41de-b7e6-a855f1914ede', '30bdd665-93ed-4242-a6d8-c9d20bfaba20', '51abde54-30a4-4e0f-a3cd-0cb917a90956'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:36:50.242861 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:36:50.247355 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e5a6d347-be32-42b3-b09a-4c99bfe470d7 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-5b49223d-1570-452d-9d2f-41d894df91cb-delete_snapshot" released by "delete_snapshot" :: held 31.067s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:36:51.386088 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-fbfb6e0d-f332-44d8-914c-1f7c94fc64d6-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:36:51.397213 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fbfb6e0d-f332-44d8-914c-1f7c94fc64d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:36:51.399818 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:37:02.849739 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:37:02.854855 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:37:02.877562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:37:02.937657 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:37:09.063487 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:37:22.079270 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:37:22.214685 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['f1cb180d-af5d-4ecd-a06b-f82ff7ec2db1', '08a2a047-03ce-4df3-ab4f-bcdbeb6b63ab', 'bbdb3795-7426-40d7-afbd-8c53fe0f9060', '12531f48-1c41-4d00-b661-b160d50dd688'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:37:22.405889 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:37:22.407860 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-86f777fe-5221-4282-96d2-d644c1feeec0 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fbfb6e0d-f332-44d8-914c-1f7c94fc64d6-delete_snapshot" released by "delete_snapshot" :: held 31.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:37:22.550439 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-9f422d23-5719-45be-93eb-92fe8d8db62e-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:37:22.562320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-9f422d23-5719-45be-93eb-92fe8d8db62e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:37:22.579065 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:37:49.057917 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:37:53.133751 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:37:53.233459 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['af40d0ad-278e-4ea2-ab6b-39970fa80384', 'dc8a5111-f4e3-4697-b844-a831f770112e', '2c027d03-9c94-4900-854c-f6f9c5ce6519', 'd2a5a480-75d2-40a8-a07e-d3f4c23de1c1'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:37:53.444376 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:37:53.449740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-4361ddce-8ce9-40d8-93a0-b16693c224ef tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-9f422d23-5719-45be-93eb-92fe8d8db62e-delete_snapshot" released by "delete_snapshot" :: held 30.888s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:37:54.632992 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-7c7c6306-caa3-44af-9425-c699b84d2134 req-db0ca427-61fd-440a-9212-2d7c853dcfe3 tempest-VolumesSnapshotTestJSON-1413768274 None] Terminate volume connection completed successfully.
Sep 06 11:37:54.633862 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-7c7c6306-caa3-44af-9425-c699b84d2134 req-db0ca427-61fd-440a-9212-2d7c853dcfe3 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleting attachment 9eac27ac-84be-47dd-906c-51cda66b6da1. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:37:59.960821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:37:59.981358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (6a1dcc47-1b4a-4a75-89d4-6ca0ab4a2552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:37:59.987642 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9047747b-20df-4b2b-a277-9702e890db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.004500 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9047747b-20df-4b2b-a277-9702e890db9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-121067625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=66b04db2-a891-47d8-a397-30ac80d44aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:38:00Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.010348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd7771-9451-4878-aa16-39225ff22834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.014511 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd7771-9451-4878-aa16-39225ff22834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.019511 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d084924-8b15-4112-9019-f10c407194ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.024156 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d084924-8b15-4112-9019-f10c407194ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b04db2-a891-47d8-a397-30ac80d44aa8', 'volume_name': 'volume-66b04db2-a891-47d8-a397-30ac80d44aa8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.028913 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0f0f60-4bfc-4fe0-a97d-f2b2df41bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.033034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0f0f60-4bfc-4fe0-a97d-f2b2df41bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.037677 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565767ea-9e88-4134-b73b-63b682c73651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.038758 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume 66b04db2-a891-47d8-a397-30ac80d44aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b04db2-a891-47d8-a397-30ac80d44aa8', 'volume_size': 1}
Sep 06 11:38:00.039198 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] creating volume 'volume-66b04db2-a891-47d8-a397-30ac80d44aa8' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:38:00.040231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:00.340524 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:38:00.341751 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:38:00.345787 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565767ea-9e88-4134-b73b-63b682c73651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b04db2-a891-47d8-a397-30ac80d44aa8', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.351136 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f41005-73d4-41cf-aeb7-7ec492ea6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:00.453216 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-66b04db2-a891-47d8-a397-30ac80d44aa8 (66b04db2-a891-47d8-a397-30ac80d44aa8): created successfully
Sep 06 11:38:00.457098 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f41005-73d4-41cf-aeb7-7ec492ea6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:00.463267 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (6a1dcc47-1b4a-4a75-89d4-6ca0ab4a2552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:00.570237 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-884698c9-ba3b-4d6c-a7cf-4de0795357b9 tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:38:01.311932 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-ad48f469-e6ea-4af5-b6e6-1c580cd4bc25 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:02.853237 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:38:02.853977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:02.877157 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:02.907455 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:03.198223 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-ad48f469-e6ea-4af5-b6e6-1c580cd4bc25 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:38:05.159362 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:38:05.187134 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (26134436-ec7f-46a7-aa7a-36f3bfb9f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:05.193408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4847c-48f3-414f-9438-ce7448365ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:05.215262 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4847c-48f3-414f-9438-ce7448365ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1018118798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:38:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0759a69e-c22d-48ab-aa53-974a2c5d6581,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:38:05Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:05.224946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ce8e9-596a-43e4-b824-2735263bd5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:05.224946 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ce8e9-596a-43e4-b824-2735263bd5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:05.230553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c02982-d5db-44a2-9592-d1e887d1f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:05.235959 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c02982-d5db-44a2-9592-d1e887d1f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3', 'volume_name': 'volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3', 'volume_size': 2, 'snapshot_id': '0759a69e-c22d-48ab-aa53-974a2c5d6581'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:05.240627 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605c2b2f-8687-455f-8d2d-167b23069ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:05.246476 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605c2b2f-8687-455f-8d2d-167b23069ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:05.252460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f68f3e7-9cf7-4cc3-92a2-a377769ddf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:05.252460 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3', 'volume_size': 2, 'snapshot_id': '0759a69e-c22d-48ab-aa53-974a2c5d6581'}
Sep 06 11:38:05.273279 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] cloning volumes/volume-66b04db2-a891-47d8-a397-30ac80d44aa8@snapshot-0759a69e-c22d-48ab-aa53-974a2c5d6581 to volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3 {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:38:05.273938 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:05.321553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:06.372110 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:38:06.372801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:38:06.377045 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:07.117873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f68f3e7-9cf7-4cc3-92a2-a377769ddf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3', 'volume_size': 2, 'snapshot_id': '0759a69e-c22d-48ab-aa53-974a2c5d6581'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:07.127834 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2339d5-206d-4717-8f45-17d6e6ee5f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:07.232411 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3 (cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3): created successfully
Sep 06 11:38:07.236414 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2339d5-206d-4717-8f45-17d6e6ee5f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:07.242409 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (26134436-ec7f-46a7-aa7a-36f3bfb9f83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:07.318400 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f3aeaf30-2edc-4f8c-b57a-63e167a02746 tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:38:08.369306 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:08.394944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:08.487249 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:08.670440 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:08.734518 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:11.832627 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['786a3db5-e477-4c7a-8518-ba0d9c59912c', '5df26c44-7a8d-4da0-b12d-b48ce7edae08', '01c3555c-4433-4bd6-94fc-b6c819c5a49b', 'e9518f1a-8a48-4d9c-a832-4af3f4e78eed'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:11.985504 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:12.010890 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:12.038837 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:12.042919 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:12.145091 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-711184f2-dfa9-4b2f-afb2-45df3e180815 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-cbef6fd4-d012-46b9-8e86-5bc1ba9bd9f3-delete_volume" released by "delete_volume" :: held 3.757s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:13.554266 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:38:13.580947 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (6b91b44b-1c23-47e4-b3c2-6bbf06bef2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:13.588210 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e41c95f-1479-4409-8028-de3eab71dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:13.605674 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e41c95f-1479-4409-8028-de3eab71dc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300523058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe59e554-8042-4966-8be8-64ce62118b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:38:13Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:13.611365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5ad49a-42a2-4836-8142-d968eccbb398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:13.615650 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5ad49a-42a2-4836-8142-d968eccbb398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:13.621724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020caaf5-2b9a-4187-9879-749119923d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:13.625669 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020caaf5-2b9a-4187-9879-749119923d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe59e554-8042-4966-8be8-64ce62118b80', 'volume_name': 'volume-fe59e554-8042-4966-8be8-64ce62118b80', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:13.630540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471006d6-4244-45ba-a78b-2c3144eabe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:13.635878 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471006d6-4244-45ba-a78b-2c3144eabe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:13.640897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742b272a-c374-48a9-bb27-536ac6a010a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:13.642339 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume fe59e554-8042-4966-8be8-64ce62118b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe59e554-8042-4966-8be8-64ce62118b80', 'volume_size': 1}
Sep 06 11:38:13.642730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] creating volume 'volume-fe59e554-8042-4966-8be8-64ce62118b80' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:38:13.643773 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:14.138446 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:38:14.139003 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:38:14.143521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742b272a-c374-48a9-bb27-536ac6a010a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe59e554-8042-4966-8be8-64ce62118b80', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:14.149484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea9765-3694-42ef-b52c-1f0f04c056b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:14.262508 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-fe59e554-8042-4966-8be8-64ce62118b80 (fe59e554-8042-4966-8be8-64ce62118b80): created successfully
Sep 06 11:38:14.268282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea9765-3694-42ef-b52c-1f0f04c056b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:14.275691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (6b91b44b-1c23-47e4-b3c2-6bbf06bef2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:14.409549 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c76aacc1-f459-4e27-8b6c-9f503fd4ad53 tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:38:15.117544 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-f2623aa4-7894-446a-8452-e1f202ef3828 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:16.832142 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-f2623aa4-7894-446a-8452-e1f202ef3828 tempest-VolumesSnapshotTestJSON-1413768274 None] Create snapshot completed successfully
Sep 06 11:38:18.220014 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:38:18.265748 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (f5b718f7-9e24-4d89-94de-2515ddf78315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:18.274968 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad96d49f-3220-4db6-a34d-31981a358c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:18.295120 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad96d49f-3220-4db6-a34d-31981a358c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847649244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbcf8b8e-6652-40c8-ad6c-2299f913954d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7c997d05c141afb82389298ecb372c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf45097c-a980-4ea2-b60f-046a8e74f575,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:38:18Z,use_quota=True,user_id='4a1fe9d40733413a9c56393762549c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:18.302559 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d8292f-7c49-42ba-8838-5a409c235baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:18.307824 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d8292f-7c49-42ba-8838-5a409c235baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:18.314185 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d505ca5-0303-437c-a7c5-556aea4c3c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:18.318610 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d505ca5-0303-437c-a7c5-556aea4c3c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fbcf8b8e-6652-40c8-ad6c-2299f913954d', 'volume_name': 'volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d', 'volume_size': 1, 'snapshot_id': 'bf45097c-a980-4ea2-b60f-046a8e74f575'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:18.325766 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a0d88b-94e5-4959-a9ce-1ad2d5ae1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:18.330295 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a0d88b-94e5-4959-a9ce-1ad2d5ae1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:18.336872 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c6aaf7-b6b0-40c1-a249-8b40770dfbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:18.339327 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Volume fbcf8b8e-6652-40c8-ad6c-2299f913954d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d', 'volume_size': 1, 'snapshot_id': 'bf45097c-a980-4ea2-b60f-046a8e74f575'}
Sep 06 11:38:18.370396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] cloning volumes/volume-fe59e554-8042-4966-8be8-64ce62118b80@snapshot-bf45097c-a980-4ea2-b60f-046a8e74f575 to volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:38:18.371454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:18.538894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:19.366025 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:38:19.366594 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:38:19.374828 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:38:19.391256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c6aaf7-b6b0-40c1-a249-8b40770dfbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d', 'volume_size': 1, 'snapshot_id': 'bf45097c-a980-4ea2-b60f-046a8e74f575'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:19.392057 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d03ab59-be85-4fa8-94c4-fec4290cdad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:38:19.489643 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d (fbcf8b8e-6652-40c8-ad6c-2299f913954d): created successfully
Sep 06 11:38:19.493454 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d03ab59-be85-4fa8-94c4-fec4290cdad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:38:19.499195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Flow 'volume_create_manager' (f5b718f7-9e24-4d89-94de-2515ddf78315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:38:19.569464 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-40717fd5-5bca-4275-9ebd-19436d8f952f tempest-VolumesSnapshotTestJSON-1413768274 None] Created volume successfully.
Sep 06 11:38:20.354795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-fbcf8b8e-6652-40c8-ad6c-2299f913954d-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:20.364526 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fbcf8b8e-6652-40c8-ad6c-2299f913954d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:20.512101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:20.700385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:20.856320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-fbcf8b8e-6652-40c8-ad6c-2299f913954d {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:23.822806 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=59,cinder:UPDATE=24,cinder:DELETE=5,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:38:23.980773 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['7081b569-a19e-4923-927c-735a504bf022', '8f942a82-7bdc-4dce-8135-fb8d176186a0', '732df53c-b530-4b1e-9068-685215d8c878', 'e824354f-5a1c-42d2-a7fa-00b619cb56e6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:24.158292 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:24.197799 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:24.225907 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:24.230314 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:24.298838 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-dbd68fda-003a-4166-9e6f-c8249257e00e tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fbcf8b8e-6652-40c8-ad6c-2299f913954d-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:24.778556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-bf45097c-a980-4ea2-b60f-046a8e74f575-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:24.802055 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-bf45097c-a980-4ea2-b60f-046a8e74f575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:24.802055 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:27.260490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['eeadafd9-ea51-41a7-b271-89cee6144bbe', '26107467-554f-4c34-b820-df4288d7b40d', 'b32ba9c9-64d8-4cfb-aaba-b6397938807b', '5dc4ba58-3975-4892-8d38-1b1aef8893b3'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:27.430888 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:38:27.435955 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-78e450ce-9e0f-49ce-afc5-97a96db72ac0 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-bf45097c-a980-4ea2-b60f-046a8e74f575-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:28.106066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-fe59e554-8042-4966-8be8-64ce62118b80-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:28.117639 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fe59e554-8042-4966-8be8-64ce62118b80-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:28.198748 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:28.298391 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:28.299051 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-fe59e554-8042-4966-8be8-64ce62118b80 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:38:28.350737 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-fe59e554-8042-4966-8be8-64ce62118b80 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:30.534686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['98d2e2e0-54fd-48c1-be1e-b049fb23e2e1', '17ab6620-2ff8-444f-996f-20accb5411aa', '650eea88-aad9-43a2-a195-700e1501fc87', '80fea887-12d8-4e3a-aa0c-0e2e1ee34526'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:30.724088 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:30.749573 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:30.776424 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:30.780663 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:30.841458 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-2ce082e7-4b75-45f2-a46c-a9d6dec0f716 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-fe59e554-8042-4966-8be8-64ce62118b80-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:31.446548 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-0759a69e-c22d-48ab-aa53-974a2c5d6581-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:31.456869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-0759a69e-c22d-48ab-aa53-974a2c5d6581-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:31.458515 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:33.415148 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['6931f877-2798-49b3-91d2-ccd490eae20b', '512283da-2ecc-4621-9e59-dc7478da626f', '26e42c54-c7ff-4473-8074-f7ab6a70268f', '0c9526a9-9107-46df-8015-9abb353de726'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:33.578837 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:38:33.585521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c59f7d58-0045-4e2d-892f-46049d83b980 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-0759a69e-c22d-48ab-aa53-974a2c5d6581-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:33.705435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-66b04db2-a891-47d8-a397-30ac80d44aa8-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:33.714856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-66b04db2-a891-47d8-a397-30ac80d44aa8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:33.800252 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=50,cinder:INSERT=10,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:38:33.803164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:33.910122 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:33.910635 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-66b04db2-a891-47d8-a397-30ac80d44aa8 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:38:34.004005 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-66b04db2-a891-47d8-a397-30ac80d44aa8 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:36.462302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['422a8489-ab83-41aa-8ee8-bb2fd0ea9537', 'bb211848-788c-4834-91e8-f1cde3c994cf', '8535d6cc-48f3-44f5-a13e-c5cecb01088e', 'da28733d-4d3c-4306-b2e7-11fa64fadcbb'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:36.613278 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:36.648715 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:36.677473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:36.682715 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:36.751287 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-34af227b-ddc8-482b-b444-990b5760cd24 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-66b04db2-a891-47d8-a397-30ac80d44aa8-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:37.245640 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-d811911f-7135-4822-aa2d-99ff0b4a1787-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:37.255903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-d811911f-7135-4822-aa2d-99ff0b4a1787-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:37.433696 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:37.572681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:37.679327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-d811911f-7135-4822-aa2d-99ff0b4a1787 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:40.416475 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:38:40.495803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] deleting parent snapshot volume-d811911f-7135-4822-aa2d-99ff0b4a1787.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:38:42.060670 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['68a830b1-e900-497a-bb12-24aa68704f9b', 'd8270e4d-5e41-49c5-a325-c74f358b52b0', '6d0c42e6-b2c1-48f7-b8d8-1d3afa36089e', '245efd00-fdd3-4ad6-90b4-2fe90a5606f0'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:42.130866 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=59,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:38:42.231702 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:42.255101 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:42.281690 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:42.285835 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:42.361788 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9d2eb169-0390-421c-ac93-5a6c3ccd3f1d tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-d811911f-7135-4822-aa2d-99ff0b4a1787-delete_volume" released by "delete_volume" :: held 5.106s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:42.714792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-51b6f2a0-c9c2-4550-b860-8bbb4cd500d1-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:42.726400 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-51b6f2a0-c9c2-4550-b860-8bbb4cd500d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:42.729070 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:44.465829 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['348490c4-027e-4108-924d-db65ef16a40b', '37b11b63-8db3-4ce1-b96f-ce0520ed8e7b', '39ade38a-adab-4b8e-a791-2a96cf3d0539', '60344f2f-6e5d-4042-98be-336790fea459'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:44.613086 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] Delete snapshot completed successfully.
Sep 06 11:38:44.618473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-e85dd451-9c52-42ef-aa99-c657972fa348 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-51b6f2a0-c9c2-4550-b860-8bbb4cd500d1-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:44.975575 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Acquiring lock "cinder-19567f19-1cb2-4e80-bf09-e8c419539694-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:38:44.985588 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-19567f19-1cb2-4e80-bf09-e8c419539694-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:38:45.084404 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:45.309320 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:38:45.309755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Volume volume-19567f19-1cb2-4e80-bf09-e8c419539694 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:38:45.372940 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] deleting rbd volume volume-19567f19-1cb2-4e80-bf09-e8c419539694 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:38:47.561134 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Created reservations ['bd3a40ad-013d-4650-9f94-e61770cecef9', '94fa82f8-d14e-4b40-a317-75430fab80e1', '3998eafa-221e-4861-987f-3f076bc71522', 'da581e11-5020-4d32-b320-5a705dfdff06'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:38:47.717224 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:47.815288 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:38:47.840801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:38:47.844977 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Deleted volume successfully.
Sep 06 11:38:47.904662 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-7d307733-3a15-4e57-b9bd-640e9c4e0906 tempest-VolumesSnapshotTestJSON-1413768274 None] Lock "cinder-19567f19-1cb2-4e80-bf09-e8c419539694-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:38:59.066959 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=45,cinder:INSERT=7,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:39:02.853607 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:39:02.858231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:02.940843 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:03.007672 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:39:06.221131 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:39:06.244240 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (b5f3f1d5-4163-4c93-bedb-1baf4c52ab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:06.251387 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee483b32-49f0-4497-8717-85d8375ac325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:06.271841 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee483b32-49f0-4497-8717-85d8375ac325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-507604656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b498e9e8-c903-455a-993d-693ed97d5726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc027a6f642454d8592b308777d59e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:39:06Z,use_quota=True,user_id='a36875e5990b487bb1357e0b46dac402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:06.277397 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af0b6bb-4835-42a8-a55c-d6eae0e2319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:06.282365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af0b6bb-4835-42a8-a55c-d6eae0e2319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:06.289289 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e1a347-7ed5-4227-a4c3-1ddec678ce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:06.409184 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e1a347-7ed5-4227-a4c3-1ddec678ce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b498e9e8-c903-455a-993d-693ed97d5726', 'volume_name': 'volume-b498e9e8-c903-455a-993d-693ed97d5726', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70319ac0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:06.424010 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad2d612-85c5-4d2e-94a8-7d0d6a670046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:06.424010 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad2d612-85c5-4d2e-94a8-7d0d6a670046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:06.425978 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8e4126-591e-418b-b202-26a16a3c6f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:06.427241 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Volume b498e9e8-c903-455a-993d-693ed97d5726: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b498e9e8-c903-455a-993d-693ed97d5726', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70319ac0>}
Sep 06 11:39:06.428033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Cloning b498e9e8-c903-455a-993d-693ed97d5726 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:39:06.428864 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:39:06.437918 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:39:06.522711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 39, 6, 442737)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:39:06.523204 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:39:06.528708 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:39:06.530869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.093s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:39:06.532038 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:39:06.596814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 39, 6, 535657)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:39:06.597242 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:39:06.597646 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:39:06.610861 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:06.802383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] creating snapshot='volume-b498e9e8-c903-455a-993d-693ed97d5726.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:39:08.418785 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-b498e9e8-c903-455a-993d-693ed97d5726.clone_snap' to 'volume-b498e9e8-c903-455a-993d-693ed97d5726' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:39:09.537703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:39:09.538894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:39:09.539319 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:39:09.767358 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:39:09.768067 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Marking volume b498e9e8-c903-455a-993d-693ed97d5726 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:39:09.888339 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to b498e9e8-c903-455a-993d-693ed97d5726. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:39:09.888806 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Creating volume glance metadata for volume b498e9e8-c903-455a-993d-693ed97d5726 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:39:10.047605 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8e4126-591e-418b-b202-26a16a3c6f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b498e9e8-c903-455a-993d-693ed97d5726', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a70319ac0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:10.058132 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10774bf3-4be0-40b1-a2e5-81f0396980bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:10.168372 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Volume volume-b498e9e8-c903-455a-993d-693ed97d5726 (b498e9e8-c903-455a-993d-693ed97d5726): created successfully
Sep 06 11:39:10.172434 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10774bf3-4be0-40b1-a2e5-81f0396980bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:10.179500 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (b5f3f1d5-4163-4c93-bedb-1baf4c52ab06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:10.271312 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9de2cb78-8e62-455b-ba46-f973235487b0 tempest-TestVolumeBootPattern-929733958 None] Created volume successfully.
Sep 06 11:39:12.149894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-9e7b9313-63fe-439f-a05d-78c84b1f4578 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:14.070645 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=46,cinder:INSERT=11,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:39:14.401653 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-9e7b9313-63fe-439f-a05d-78c84b1f4578 tempest-TestVolumeBootPattern-929733958 None] Create snapshot completed successfully
Sep 06 11:39:20.530027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:39:20.564291 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (226b34e3-d08f-4be3-b853-b1e6304da881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:20.573307 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657d721c-b4c5-4349-934b-b9538f6172c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:20.597027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657d721c-b4c5-4349-934b-b9538f6172c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:39:20Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e5ba473-8f63-4372-aa05-dfdc476753cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc027a6f642454d8592b308777d59e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8363fcb-784c-4aa1-b3ac-54356f34c8b5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:39:20Z,use_quota=True,user_id='a36875e5990b487bb1357e0b46dac402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:20.602646 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3448b68-45d3-4715-a97a-87f459966519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:20.608114 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3448b68-45d3-4715-a97a-87f459966519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:20.613969 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e61bd2-9d73-4885-8646-9ac89f8d53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:20.618827 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e61bd2-9d73-4885-8646-9ac89f8d53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e5ba473-8f63-4372-aa05-dfdc476753cb', 'volume_name': 'volume-6e5ba473-8f63-4372-aa05-dfdc476753cb', 'volume_size': 1, 'snapshot_id': 'f8363fcb-784c-4aa1-b3ac-54356f34c8b5'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:20.624569 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7329a3-d5a1-4c00-a047-ac29e83bb99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:20.631197 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7329a3-d5a1-4c00-a047-ac29e83bb99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:20.637340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18cfab-2346-4ff1-98c7-04f80c9cd9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:20.638774 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Volume 6e5ba473-8f63-4372-aa05-dfdc476753cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e5ba473-8f63-4372-aa05-dfdc476753cb', 'volume_size': 1, 'snapshot_id': 'f8363fcb-784c-4aa1-b3ac-54356f34c8b5'}
Sep 06 11:39:20.664001 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] cloning volumes/volume-b498e9e8-c903-455a-993d-693ed97d5726@snapshot-f8363fcb-784c-4aa1-b3ac-54356f34c8b5 to volume-6e5ba473-8f63-4372-aa05-dfdc476753cb {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:39:20.664001 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:20.738873 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:21.808298 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:39:21.808948 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:39:21.828417 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Marking volume 6e5ba473-8f63-4372-aa05-dfdc476753cb as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:39:21.932052 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Copying metadata from snapshot f8363fcb-784c-4aa1-b3ac-54356f34c8b5 to 6e5ba473-8f63-4372-aa05-dfdc476753cb. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}}
Sep 06 11:39:22.039499 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18cfab-2346-4ff1-98c7-04f80c9cd9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5ba473-8f63-4372-aa05-dfdc476753cb', 'volume_size': 1, 'snapshot_id': 'f8363fcb-784c-4aa1-b3ac-54356f34c8b5'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:22.044049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fefb4b-cb3c-463d-9a4b-c8cf6c58d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:22.127937 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Volume volume-6e5ba473-8f63-4372-aa05-dfdc476753cb (6e5ba473-8f63-4372-aa05-dfdc476753cb): created successfully
Sep 06 11:39:22.131718 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fefb4b-cb3c-463d-9a4b-c8cf6c58d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:22.137752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (226b34e3-d08f-4be3-b853-b1e6304da881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:22.241881 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5a71a089-fba9-4b1e-88e4-5f1f09601d37 tempest-TestVolumeBootPattern-929733958 None] Created volume successfully.
Sep 06 11:39:23.683404 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5979606d-42f3-410e-a7ad-c15c991467fb tempest-TestVolumeBootPattern-929733958 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:39:24.449435 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5979606d-42f3-410e-a7ad-c15c991467fb tempest-TestVolumeBootPattern-929733958 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.766s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:39:24.450280 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5979606d-42f3-410e-a7ad-c15c991467fb tempest-TestVolumeBootPattern-929733958 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6e5ba473-8f63-4372-aa05-dfdc476753cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '6e5ba473-8f63-4372-aa05-dfdc476753cb', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:39:24.579385 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5979606d-42f3-410e-a7ad-c15c991467fb tempest-TestVolumeBootPattern-929733958 None] Connection info returned from driver {'name': 'volumes/volume-6e5ba473-8f63-4372-aa05-dfdc476753cb', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6e5ba473-8f63-4372-aa05-dfdc476753cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '762c21f0-a676-45f7-9bcf-edd6303ab4ef'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:39:24.681475 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-ba69b5f8-2965-4f2c-bb2d-6c097b7933d5 req-5979606d-42f3-410e-a7ad-c15c991467fb tempest-TestVolumeBootPattern-929733958 None] attachment_update completed successfully.
Sep 06 11:39:37.342322 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=59,cinder:INSERT=23,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:39:37.353717 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-cf70d849-b036-43ce-ac64-f717510027aa tempest-TestVolumeBootPattern-929733958 None] Terminate volume connection completed successfully.
Sep 06 11:39:37.354351 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-cf70d849-b036-43ce-ac64-f717510027aa tempest-TestVolumeBootPattern-929733958 None] Deleting attachment 762c21f0-a676-45f7-9bcf-edd6303ab4ef. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:39:37.700127 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-6e5ba473-8f63-4372-aa05-dfdc476753cb-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:39:37.709747 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-6e5ba473-8f63-4372-aa05-dfdc476753cb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:39:37.869105 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:38.079634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:39:38.134078 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] deleting rbd volume volume-6e5ba473-8f63-4372-aa05-dfdc476753cb {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:39:40.617496 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Created reservations ['9964cf7d-b044-4f6c-99c1-951c2560bb3c', '72a3dd15-9c7d-44de-91ab-5cbfc2f72219', 'd0ae8ddc-0a97-457f-a4f7-d5bbdf507b31', '4e7acb6b-918e-49e3-91de-9ab5bca6e1df'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:39:40.802562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:40.832725 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:40.861172 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:39:40.868394 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Deleted volume successfully.
Sep 06 11:39:40.925899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-14406af1-6dbc-480e-a3d2-755dd91d52cc req-75178bcd-aec9-47b4-a278-1a645a2dc295 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-6e5ba473-8f63-4372-aa05-dfdc476753cb-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:39:41.940333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-f8363fcb-784c-4aa1-b3ac-54356f34c8b5-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:39:41.949899 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-f8363fcb-784c-4aa1-b3ac-54356f34c8b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:39:41.951634 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:43.538895 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] Created reservations ['b7084dc2-895a-41bc-ad49-bbcd9f9836d7', '964c7aaa-37a2-4902-922f-f2e451df67e9', '85a65b10-78f8-4228-aa9c-ef10e633dd68', 'da0d6aa6-3fe1-46ed-a8f8-42fca3039d17'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:39:43.805722 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] Delete snapshot completed successfully.
Sep 06 11:39:43.810435 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-fa822351-9bd4-4031-8a56-5332cfddae0e tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-f8363fcb-784c-4aa1-b3ac-54356f34c8b5-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:39:44.223457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-b498e9e8-c903-455a-993d-693ed97d5726-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:39:44.233514 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b498e9e8-c903-455a-993d-693ed97d5726-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:39:44.305721 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:44.406821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:39:44.442858 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] deleting rbd volume volume-b498e9e8-c903-455a-993d-693ed97d5726 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:39:46.711365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:39:46.871309 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] deleting parent snapshot volume-b498e9e8-c903-455a-993d-693ed97d5726.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:39:48.204046 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=51,cinder:DELETE=2,cinder:UPDATE=20,cinder:INSERT=10 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:39:48.310095 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Created reservations ['e7f5110a-995b-4ed7-93cf-0c7eeb5c2d40', 'f240b626-e046-42d0-90b1-aa752ec33eb7', '6944f32a-6019-43bf-ac34-8c636a11dea8', 'd32e2edd-fa36-485b-8e74-b6641dd12c3d'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:39:48.543746 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:48.639145 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:48.667344 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:39:48.672891 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Deleted volume successfully.
Sep 06 11:39:48.765966 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-0273e275-891d-4e9e-a5b5-8ba3c64f85e8 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b498e9e8-c903-455a-993d-693ed97d5726-delete_volume" released by "delete_volume" :: held 4.533s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:39:49.527854 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:39:49.548530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (51bc57df-8fcf-43f2-9812-d68c49c03647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:49.554751 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ffc712-4bd5-4c65-af6f-17036781d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:49.570080 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ffc712-4bd5-4c65-af6f-17036781d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-31347985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=169b6d3b-4e9b-4155-abb3-f8285161aaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc027a6f642454d8592b308777d59e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:39:49Z,use_quota=True,user_id='a36875e5990b487bb1357e0b46dac402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:49.575844 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2287c0dc-c93e-46cc-a3fa-008481a75645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:49.579831 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2287c0dc-c93e-46cc-a3fa-008481a75645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:49.584681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf6cd5-df4b-46f0-bd6e-2cc098b1922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:49.666704 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf6cd5-df4b-46f0-bd6e-2cc098b1922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'volume_name': 'volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702b5fd0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:49.671473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0362a2-8934-415f-9ed1-7b8d090d0053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:49.675380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0362a2-8934-415f-9ed1-7b8d090d0053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:49.679860 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54508bbd-6d30-4c16-9fba-870c1d359554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:49.680944 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Volume 169b6d3b-4e9b-4155-abb3-f8285161aaf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702b5fd0>}
Sep 06 11:39:49.681535 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Cloning 169b6d3b-4e9b-4155-abb3-f8285161aaf2 from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:39:49.682799 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:39:49.690550 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:39:49.761923 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 39, 49, 694671)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:39:49.762152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:39:49.763193 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:39:49.768983 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:39:49.771305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:39:49.781039 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 39, 49, 776980)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:39:49.781631 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:39:49.782111 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:39:49.793733 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:39:49.926521 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] creating snapshot='volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:39:51.395456 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2.clone_snap' to 'volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:39:52.186813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:39:52.188037 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:39:52.188412 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:39:52.486141 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:39:52.486772 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Marking volume 169b6d3b-4e9b-4155-abb3-f8285161aaf2 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:39:52.555486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 169b6d3b-4e9b-4155-abb3-f8285161aaf2. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:39:52.555914 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Creating volume glance metadata for volume 169b6d3b-4e9b-4155-abb3-f8285161aaf2 backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:39:52.586812 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=53,cinder:UPDATE=32,cinder:INSERT=14,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:39:52.707508 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54508bbd-6d30-4c16-9fba-870c1d359554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a702b5fd0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:52.711912 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1a7912-d80c-4577-9f77-1ec0c8f6e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:39:52.795262 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Volume volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2 (169b6d3b-4e9b-4155-abb3-f8285161aaf2): created successfully
Sep 06 11:39:52.798726 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1a7912-d80c-4577-9f77-1ec0c8f6e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:39:52.804112 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (51bc57df-8fcf-43f2-9812-d68c49c03647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:39:52.875431 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c414837b-ad26-4278-9525-6dd0b3109c74 tempest-TestVolumeBootPattern-929733958 None] Created volume successfully.
Sep 06 11:39:57.415506 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 req-524c0bdb-f2fa-4d4d-ba6f-7e2f1b34e43e tempest-TestVolumeBootPattern-929733958 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:39:58.264688 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 req-524c0bdb-f2fa-4d4d-ba6f-7e2f1b34e43e tempest-TestVolumeBootPattern-929733958 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:39:58.266217 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 req-524c0bdb-f2fa-4d4d-ba6f-7e2f1b34e43e tempest-TestVolumeBootPattern-929733958 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:39:58.345930 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 req-524c0bdb-f2fa-4d4d-ba6f-7e2f1b34e43e tempest-TestVolumeBootPattern-929733958 None] Connection info returned from driver {'name': 'volumes/volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '169b6d3b-4e9b-4155-abb3-f8285161aaf2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd981dc4e-fd4a-4201-8073-9423d109ab08'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:39:58.452323 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-6b611dab-c0e3-477b-b2b6-18d9a5e25149 req-524c0bdb-f2fa-4d4d-ba6f-7e2f1b34e43e tempest-TestVolumeBootPattern-929733958 None] attachment_update completed successfully.
Sep 06 11:40:02.853969 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:40:02.856449 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:02.895366 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:02.930070 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:40:09.005291 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-791331b2-7906-404c-aba5-548f983ff9b6 req-408a33fb-cc6b-4254-b1eb-2f336df5c51d tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:10.692535 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-791331b2-7906-404c-aba5-548f983ff9b6 req-408a33fb-cc6b-4254-b1eb-2f336df5c51d tempest-TestVolumeBootPattern-929733958 None] Create snapshot completed successfully
Sep 06 11:40:15.168031 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:40:15.196712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (ae9ce27b-788c-42eb-a07c-b704de0a1138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:40:15.204132 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aa8526-7ba2-4429-9e1f-76b51a908df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:15.224324 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aa8526-7ba2-4429-9e1f-76b51a908df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:40:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4cc336e7-3e33-4045-9ecc-9a45755e35d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc027a6f642454d8592b308777d59e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c8fc43c-28ea-4093-9f52-c2d8acd25044,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:40:15Z,use_quota=True,user_id='a36875e5990b487bb1357e0b46dac402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:15.226560 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4242dc-e841-4a4d-a397-81dc0d826566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:15.230821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4242dc-e841-4a4d-a397-81dc0d826566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:15.235813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7c419e-41c2-49af-a0d1-ec7549b8edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:15.239812 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7c419e-41c2-49af-a0d1-ec7549b8edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'volume_name': 'volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'volume_size': 1, 'snapshot_id': '3c8fc43c-28ea-4093-9f52-c2d8acd25044'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:15.244580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1cd169-fa60-4383-aa44-cd3b1b0a6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:15.248987 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1cd169-fa60-4383-aa44-cd3b1b0a6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:15.253653 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72dc218-d320-40b0-aeee-110a4b49d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:15.254729 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Volume 4cc336e7-3e33-4045-9ecc-9a45755e35d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'volume_size': 1, 'snapshot_id': '3c8fc43c-28ea-4093-9f52-c2d8acd25044'}
Sep 06 11:40:15.278387 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] cloning volumes/volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2@snapshot-3c8fc43c-28ea-4093-9f52-c2d8acd25044 to volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4 {{(pid=133823) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Sep 06 11:40:15.279073 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:15.347408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:16.360682 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:40:16.361364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:40:16.382409 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Marking volume 4cc336e7-3e33-4045-9ecc-9a45755e35d4 as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:40:16.457900 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Copying metadata from snapshot 3c8fc43c-28ea-4093-9f52-c2d8acd25044 to 4cc336e7-3e33-4045-9ecc-9a45755e35d4. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}}
Sep 06 11:40:16.575745 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72dc218-d320-40b0-aeee-110a4b49d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'volume_size': 1, 'snapshot_id': '3c8fc43c-28ea-4093-9f52-c2d8acd25044'}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:16.580394 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbb74f5-a0a2-4142-a148-68691fdc031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:40:16.679554 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Volume volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4 (4cc336e7-3e33-4045-9ecc-9a45755e35d4): created successfully
Sep 06 11:40:16.683312 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbb74f5-a0a2-4142-a148-68691fdc031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:40:16.689365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (ae9ce27b-788c-42eb-a07c-b704de0a1138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:40:16.749195 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-8c9337dc-8509-496d-8a66-36520df6ad74 tempest-TestVolumeBootPattern-929733958 None] Created volume successfully.
Sep 06 11:40:18.394940 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-c51eb067-dd65-486e-9eb0-7d442d581cc3 tempest-TestVolumeBootPattern-929733958 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:40:19.159391 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=11,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=18 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:40:19.251650 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-c51eb067-dd65-486e-9eb0-7d442d581cc3 tempest-TestVolumeBootPattern-929733958 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.857s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:40:19.252520 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-c51eb067-dd65-486e-9eb0-7d442d581cc3 tempest-TestVolumeBootPattern-929733958 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:40:19.344007 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-c51eb067-dd65-486e-9eb0-7d442d581cc3 tempest-TestVolumeBootPattern-929733958 None] Connection info returned from driver {'name': 'volumes/volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4cc336e7-3e33-4045-9ecc-9a45755e35d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ba5cf785-463f-410f-8cac-ee58d7ca13da'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:40:19.540021 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a35a9a57-4369-4afe-923b-b3512ca823f2 req-c51eb067-dd65-486e-9eb0-7d442d581cc3 tempest-TestVolumeBootPattern-929733958 None] attachment_update completed successfully.
Sep 06 11:40:29.174458 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=50,cinder:UPDATE=10,cinder:INSERT=13,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:40:33.235956 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-6e74dc9a-6c95-450a-8f6f-afd73d2eeb07 tempest-TestVolumeBootPattern-929733958 None] Terminate volume connection completed successfully.
Sep 06 11:40:33.247869 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-6e74dc9a-6c95-450a-8f6f-afd73d2eeb07 tempest-TestVolumeBootPattern-929733958 None] Deleting attachment ba5cf785-463f-410f-8cac-ee58d7ca13da. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:40:33.717700 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-4cc336e7-3e33-4045-9ecc-9a45755e35d4-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:40:33.742231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-4cc336e7-3e33-4045-9ecc-9a45755e35d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:40:33.844457 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:34.211854 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:40:34.415814 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] deleting rbd volume volume-4cc336e7-3e33-4045-9ecc-9a45755e35d4 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:40:40.331783 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Created reservations ['d5065f0e-c2ad-4263-b92c-b0cbce2fcd8b', '4287e636-466a-4c84-9e76-f6030b5773a2', 'ba3dd95c-3d5e-4723-bcf3-f50199685039', 'f4509640-5471-4f6d-865f-9ad40b7aa1ea'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:40:40.497902 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:40.527302 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:40.562909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:40:40.570576 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Deleted volume successfully.
Sep 06 11:40:40.661677 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-a595f6c2-ba37-4616-b2a6-e97b7fea7545 req-40817ac7-a4a7-45fc-9f6c-374b77b20b1f tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-4cc336e7-3e33-4045-9ecc-9a45755e35d4-delete_volume" released by "delete_volume" :: held 6.920s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:40:40.896437 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-3c8fc43c-28ea-4093-9f52-c2d8acd25044-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:40:40.906609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-3c8fc43c-28ea-4093-9f52-c2d8acd25044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:40:40.909697 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:40:59.156531 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:41:02.853472 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:41:02.854126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:02.876365 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:02.899496 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:41:09.156180 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:41:11.651039 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] Created reservations ['02ea3c0a-f564-492b-86aa-baba6dffe2cc', 'ece6efde-8c90-4c05-bca4-10dc83ada2bb', '84e99201-20c4-48a5-91b7-4d9ab447214c', '4f8b0204-796c-4fb6-a9b8-8f9aadd99842'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:41:11.851087 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] Delete snapshot completed successfully.
Sep 06 11:41:11.855839 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-c44f709f-d1a0-4a2e-a9e0-23d4ea98daa3 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-3c8fc43c-28ea-4093-9f52-c2d8acd25044-delete_snapshot" released by "delete_snapshot" :: held 30.949s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:41:14.821070 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-db7e2248-34e6-491d-9d48-536d22e01e8b tempest-TestVolumeBootPattern-929733958 None] Terminate volume connection completed successfully.
Sep 06 11:41:14.821724 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-db7e2248-34e6-491d-9d48-536d22e01e8b tempest-TestVolumeBootPattern-929733958 None] Deleting attachment d981dc4e-fd4a-4201-8073-9423d109ab08. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:41:15.119503 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-169b6d3b-4e9b-4155-abb3-f8285161aaf2-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:41:15.129292 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-169b6d3b-4e9b-4155-abb3-f8285161aaf2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:41:15.234206 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:15.376466 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:41:15.452730 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] deleting rbd volume volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:41:18.098221 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:41:18.217609 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] deleting parent snapshot volume-169b6d3b-4e9b-4155-abb3-f8285161aaf2.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:41:20.038852 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Created reservations ['21103fc0-ef81-4bd5-89de-8de65b5ca286', '280eab58-0d94-4339-95ec-60fcb46c5aab', '00aadf80-8459-4765-977a-6b8b2371e82c', '43b4da80-3f44-4a7b-9a28-2468885f8eab'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:41:20.216543 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:20.239549 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:20.264474 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:41:20.270148 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Deleted volume successfully.
Sep 06 11:41:20.357136 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-24b65dbc-8c86-4faa-93ed-122c01f35204 req-4fdf1d49-a3df-4560-a85c-5ef44113a5c5 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-169b6d3b-4e9b-4155-abb3-f8285161aaf2-delete_volume" released by "delete_volume" :: held 5.228s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:41:25.321018 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:41:25.341810 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (c7b396ed-1505-4967-886f-cf4cc0aecb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:41:25.348061 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df979c-421e-4b4b-a907-3e65d2e67322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:25.364619 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df979c-421e-4b4b-a907-3e65d2e67322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-932730896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=957404cf-5ff8-4abb-99cf-02aca65af86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc027a6f642454d8592b308777d59e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:41:25Z,use_quota=True,user_id='a36875e5990b487bb1357e0b46dac402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:25.369883 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404288e-6280-4a70-b90f-48393865ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:25.373810 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0404288e-6280-4a70-b90f-48393865ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:25.379492 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233a4132-2369-4d62-b609-a7767bc7e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:25.462147 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233a4132-2369-4d62-b609-a7767bc7e96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '957404cf-5ff8-4abb-99cf-02aca65af86d', 'volume_name': 'volume-957404cf-5ff8-4abb-99cf-02aca65af86d', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706f1cd0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:25.467304 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d4fb34-eb60-4bc3-95e1-ea608fff6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:25.472035 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d4fb34-eb60-4bc3-95e1-ea608fff6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:25.476825 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0762866a-9454-41c5-9a83-8e1fddfecfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:25.478613 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Volume 957404cf-5ff8-4abb-99cf-02aca65af86d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-957404cf-5ff8-4abb-99cf-02aca65af86d', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706f1cd0>}
Sep 06 11:41:25.479226 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Cloning 957404cf-5ff8-4abb-99cf-02aca65af86d from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 11:41:25.479991 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:41:25.490275 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:41:25.553513 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 41, 25, 494979)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:41:25.553977 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:41:25.554384 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 11:41:25.558629 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.070s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:41:25.559608 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 11:41:25.650411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 11, 41, 25, 563143)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 11:41:25.650771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 11:41:25.651199 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 11:41:25.664327 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:41:25.798679 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] creating snapshot='volume-957404cf-5ff8-4abb-99cf-02aca65af86d.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 11:41:27.028482 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-957404cf-5ff8-4abb-99cf-02aca65af86d.clone_snap' to 'volume-957404cf-5ff8-4abb-99cf-02aca65af86d' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 11:41:27.788453 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:41:27.789711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:41:27.790086 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:41:28.038438 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 11:41:28.039200 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Marking volume 957404cf-5ff8-4abb-99cf-02aca65af86d as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 11:41:28.101691 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to 957404cf-5ff8-4abb-99cf-02aca65af86d. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 11:41:28.102115 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Creating volume glance metadata for volume 957404cf-5ff8-4abb-99cf-02aca65af86d backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 11:41:28.202232 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0762866a-9454-41c5-9a83-8e1fddfecfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957404cf-5ff8-4abb-99cf-02aca65af86d', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a706f1cd0>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:28.207152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00972aee-2199-47fa-b6e0-655b3ffac9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:41:28.261768 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Volume volume-957404cf-5ff8-4abb-99cf-02aca65af86d (957404cf-5ff8-4abb-99cf-02aca65af86d): created successfully
Sep 06 11:41:28.265553 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00972aee-2199-47fa-b6e0-655b3ffac9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:41:28.271795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Flow 'volume_create_manager' (c7b396ed-1505-4967-886f-cf4cc0aecb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:41:28.329613 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-becfb90a-b607-40c3-b6e5-c007c9311c30 tempest-TestVolumeBootPattern-929733958 None] Created volume successfully.
Sep 06 11:41:29.927409 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=47,cinder:UPDATE=17,cinder:INSERT=8,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:41:32.887721 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-298442f8-9c6d-4fdb-a070-c625f716c6ac req-4e77fddc-e559-4810-b5ff-4fdbd17137ec tempest-TestVolumeBootPattern-929733958 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:41:33.670423 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-298442f8-9c6d-4fdb-a070-c625f716c6ac req-4e77fddc-e559-4810-b5ff-4fdbd17137ec tempest-TestVolumeBootPattern-929733958 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.783s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:41:33.671758 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-298442f8-9c6d-4fdb-a070-c625f716c6ac req-4e77fddc-e559-4810-b5ff-4fdbd17137ec tempest-TestVolumeBootPattern-929733958 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-957404cf-5ff8-4abb-99cf-02aca65af86d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '957404cf-5ff8-4abb-99cf-02aca65af86d', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:41:33.776462 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-298442f8-9c6d-4fdb-a070-c625f716c6ac req-4e77fddc-e559-4810-b5ff-4fdbd17137ec tempest-TestVolumeBootPattern-929733958 None] Connection info returned from driver {'name': 'volumes/volume-957404cf-5ff8-4abb-99cf-02aca65af86d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '957404cf-5ff8-4abb-99cf-02aca65af86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '154624a9-3b49-4367-ba56-2a762bed7680'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:41:33.891900 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-298442f8-9c6d-4fdb-a070-c625f716c6ac req-4e77fddc-e559-4810-b5ff-4fdbd17137ec tempest-TestVolumeBootPattern-929733958 None] attachment_update completed successfully.
Sep 06 11:41:39.929442 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=47,cinder:INSERT=12,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:41:59.933016 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:42:02.855579 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:42:02.856375 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:42:02.882353 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:42:02.907597 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:42:09.941817 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:42:19.944801 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:42:49.942863 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:42:49.943588 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:43:02.853985 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:43:02.854743 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:43:02.878780 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:43:02.903203 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:43:09.952522 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:43:29.953330 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:43:29.954050 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:43:49.954338 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:44:02.851854 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:44:02.852556 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:44:02.875943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:44:02.901247 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:44:09.953348 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:44:29.954370 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:44:29.956466 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:44:49.966101 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:45:02.849052 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:45:02.849792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:45:02.872871 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:45:02.897094 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:45:09.967094 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:45:19.975655 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:45:22.185314 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-74053faf-439e-4401-9481-fbd2e5ea7b96 req-66baaece-0663-49dc-834b-756ae6ab52a3 tempest-TestVolumeBootPattern-929733958 None] Terminate volume connection completed successfully.
Sep 06 11:45:22.185982 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-74053faf-439e-4401-9481-fbd2e5ea7b96 req-66baaece-0663-49dc-834b-756ae6ab52a3 tempest-TestVolumeBootPattern-929733958 None] Deleting attachment 154624a9-3b49-4367-ba56-2a762bed7680. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:45:23.479655 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Acquiring lock "cinder-957404cf-5ff8-4abb-99cf-02aca65af86d-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:45:23.489519 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-957404cf-5ff8-4abb-99cf-02aca65af86d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:45:23.610754 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:45:23.747329 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:45:23.790831 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] deleting rbd volume volume-957404cf-5ff8-4abb-99cf-02aca65af86d {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:45:26.348671 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 11:45:26.422648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] deleting parent snapshot volume-957404cf-5ff8-4abb-99cf-02aca65af86d.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 11:45:27.976522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Created reservations ['65062153-0fb4-48d7-acda-b0654b9f982e', 'e2f9ef1e-7e43-484a-b7ca-8907ae7e109b', '01ca1cb5-5b89-4d53-b66d-66294c0708f5', '634d1334-3fd9-4179-95ae-f33b854306b6'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:45:28.171214 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:45:28.195612 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:45:28.220802 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:45:28.226475 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Deleted volume successfully.
Sep 06 11:45:28.288381 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-88a9b24c-b6da-4602-8d7a-f0f5ccf97353 tempest-TestVolumeBootPattern-929733958 None] Lock "cinder-957404cf-5ff8-4abb-99cf-02aca65af86d-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:45:38.231188 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:45:39.976148 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:46:02.852930 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:46:02.853603 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:46:02.877106 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:46:02.900961 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:46:09.977295 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:46:09.979707 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:46:29.986223 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:46:49.989417 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:47:02.857144 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:47:02.857813 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:47:02.885613 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:47:02.909152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:47:09.992629 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:47:19.995311 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:47:50.006482 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:47:59.996693 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:48:02.855321 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:48:02.856361 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:48:02.891346 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:48:02.931364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:48:20.001285 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:48:40.005570 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:48:40.006273 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:49:00.008542 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:49:02.857240 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:49:02.857985 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:49:02.887296 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:49:02.926815 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:49:20.011208 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:49:40.009821 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:50:00.014998 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:50:02.856250 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:50:02.856965 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:50:02.884256 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:50:02.911595 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:50:20.018654 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:50:40.008872 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:51:00.001672 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:51:02.857652 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:51:02.859297 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:51:02.903313 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:51:02.941259 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:51:20.005043 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:51:20.016276 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:51:40.018275 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:52:00.026640 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:52:02.857916 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:52:02.858998 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:52:02.898225 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:52:02.933493 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:52:20.020376 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:52:30.028621 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:52:50.034226 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:53:02.860154 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:53:02.861413 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:53:02.891832 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:53:02.923929 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:53:20.032484 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:53:30.035337 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:54:00.040315 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:54:02.859792 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:54:02.860514 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:54:02.884390 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:54:02.910937 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:54:10.038518 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:54:40.041802 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:54:50.040290 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:55:02.856872 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:55:02.857575 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:55:02.893344 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:55:02.921465 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:55:10.046028 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:55:20.048960 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:55:30.056334 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:00.049316 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:02.857911 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:56:02.858878 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:56:02.887698 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:56:02.919755 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:56:10.046727 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:20.053790 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:24.995563 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:56:25.016195 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Flow 'volume_create_manager' (a67b3d4f-d70b-4f5a-930e-58f54b5c75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:56:25.022868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5a9ba8-f3d5-4061-bb23-351bd641590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.040670 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5a9ba8-f3d5-4061-bb23-351bd641590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1081436210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=424f3e42-8c1b-46bf-bef5-aca7d79e7532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe9b44c84c6418387b9c76f8dda94df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:56:25Z,use_quota=True,user_id='3d09c9d5440c4987a99e81bfed501cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.046625 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a287921e-4699-4900-aa60-dd8ebe4dc470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.050917 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a287921e-4699-4900-aa60-dd8ebe4dc470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.056768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094518e4-025a-4071-b110-9b8beed218f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.060903 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094518e4-025a-4071-b110-9b8beed218f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'volume_name': 'volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.066170 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd70f42d-43b6-48bd-b8f7-0b31831b6c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.071990 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd70f42d-43b6-48bd-b8f7-0b31831b6c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.078368 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25476526-22f6-4eef-85b0-ba516a6541da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.079376 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Volume 424f3e42-8c1b-46bf-bef5-aca7d79e7532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'volume_size': 1}
Sep 06 11:56:25.079810 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] creating volume 'volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:56:25.080680 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:56:25.701999 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:56:25.702561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:56:25.709323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25476526-22f6-4eef-85b0-ba516a6541da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.717584 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa523c-ec05-4842-9666-0515e27a826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:56:25.801968 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Volume volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532 (424f3e42-8c1b-46bf-bef5-aca7d79e7532): created successfully
Sep 06 11:56:25.807531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7baa523c-ec05-4842-9666-0515e27a826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:56:25.818301 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Flow 'volume_create_manager' (a67b3d4f-d70b-4f5a-930e-58f54b5c75f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:56:25.947542 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-73956136-b67d-46da-a900-933b568d1fd5 tempest-ServerActionsTestJSON-1249565603 None] Created volume successfully.
Sep 06 11:56:28.139488 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a98b0341-636e-46f1-a3a0-2194a084a583 req-ff02b540-3695-4efb-a60d-5c9bc936811e tempest-ServerActionsTestJSON-1249565603 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:56:28.892392 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-a98b0341-636e-46f1-a3a0-2194a084a583 req-ff02b540-3695-4efb-a60d-5c9bc936811e tempest-ServerActionsTestJSON-1249565603 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.753s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:56:28.893290 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-a98b0341-636e-46f1-a3a0-2194a084a583 req-ff02b540-3695-4efb-a60d-5c9bc936811e tempest-ServerActionsTestJSON-1249565603 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:56:28.962146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a98b0341-636e-46f1-a3a0-2194a084a583 req-ff02b540-3695-4efb-a60d-5c9bc936811e tempest-ServerActionsTestJSON-1249565603 None] Connection info returned from driver {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '98f008db-9975-4813-9870-05d09eaab025'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:56:29.085235 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a98b0341-636e-46f1-a3a0-2194a084a583 req-ff02b540-3695-4efb-a60d-5c9bc936811e tempest-ServerActionsTestJSON-1249565603 None] attachment_update completed successfully.
Sep 06 11:56:39.085058 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:50.056033 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:54.364508 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=24,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:56:54.368605 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-14cb24b9-6920-483a-ba21-f84d06fc6f96 tempest-ServerActionsTestJSON-1249565603 None] Terminate volume connection completed successfully.
Sep 06 11:56:54.369027 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-14cb24b9-6920-483a-ba21-f84d06fc6f96 tempest-ServerActionsTestJSON-1249565603 None] Deleting attachment 98f008db-9975-4813-9870-05d09eaab025. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:56:58.050223 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-781a8db5-547a-46a8-9265-dce1b1f2e667 tempest-ServerActionsTestJSON-1249565603 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:56:58.939118 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-781a8db5-547a-46a8-9265-dce1b1f2e667 tempest-ServerActionsTestJSON-1249565603 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.888s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:56:58.940596 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-781a8db5-547a-46a8-9265-dce1b1f2e667 tempest-ServerActionsTestJSON-1249565603 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:56:59.076761 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-781a8db5-547a-46a8-9265-dce1b1f2e667 tempest-ServerActionsTestJSON-1249565603 None] Connection info returned from driver {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26f0d4be-1d08-4439-9f0e-47f521a2616a'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:56:59.294784 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-652ab556-b13a-4e2b-b506-1797bf1c56eb req-781a8db5-547a-46a8-9265-dce1b1f2e667 tempest-ServerActionsTestJSON-1249565603 None] attachment_update completed successfully.
Sep 06 11:57:02.856666 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:57:02.857484 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:57:02.895816 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:57:02.927914 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:57:08.621909 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-22957341-13a0-42f5-adf8-4c0a676790b7 tempest-ServerActionsTestJSON-1249565603 None] Terminate volume connection completed successfully.
Sep 06 11:57:08.622752 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-22957341-13a0-42f5-adf8-4c0a676790b7 tempest-ServerActionsTestJSON-1249565603 None] Deleting attachment 26f0d4be-1d08-4439-9f0e-47f521a2616a. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:57:12.325365 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-2935b965-e2d9-474a-b3e4-2c370a330285 tempest-ServerActionsTestJSON-1249565603 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:57:13.121784 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-2935b965-e2d9-474a-b3e4-2c370a330285 tempest-ServerActionsTestJSON-1249565603 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.796s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:57:13.122817 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-2935b965-e2d9-474a-b3e4-2c370a330285 tempest-ServerActionsTestJSON-1249565603 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:57:13.208169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-2935b965-e2d9-474a-b3e4-2c370a330285 tempest-ServerActionsTestJSON-1249565603 None] Connection info returned from driver {'name': 'volumes/volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '424f3e42-8c1b-46bf-bef5-aca7d79e7532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b19a7dd-4377-4787-9ebf-5f1771a96e65'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:57:13.318800 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-54f1b301-ffb8-4bcb-8079-768e043e1e9a req-2935b965-e2d9-474a-b3e4-2c370a330285 tempest-ServerActionsTestJSON-1249565603 None] attachment_update completed successfully.
Sep 06 11:57:22.711851 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=28,cinder:UPDATE=6 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:57:22.715825 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 req-b0eea57b-d0c9-41de-8803-be880238f4b3 tempest-ServerActionsTestJSON-1249565603 None] Terminate volume connection completed successfully.
Sep 06 11:57:22.716254 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-a2eb1c1b-3ba0-4842-9016-be41f61f80c4 req-b0eea57b-d0c9-41de-8803-be880238f4b3 tempest-ServerActionsTestJSON-1249565603 None] Deleting attachment 0b19a7dd-4377-4787-9ebf-5f1771a96e65. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 11:57:24.767868 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Acquiring lock "cinder-424f3e42-8c1b-46bf-bef5-aca7d79e7532-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 11:57:24.785125 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Lock "cinder-424f3e42-8c1b-46bf-bef5-aca7d79e7532-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 11:57:24.785125 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=35,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:57:24.920545 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:57:25.062411 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 11:57:25.062915 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Volume volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532 is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 11:57:25.160313 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] deleting rbd volume volume-424f3e42-8c1b-46bf-bef5-aca7d79e7532 {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 11:57:28.073943 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Created reservations ['44cbf4d8-ab86-4214-ad6a-7ee38e3c860c', '7cc62d70-aee1-4755-8273-0a27bd2ebbd0', '220803d6-c8ec-4f5b-9a0b-840ea5c96093', 'f0ef19b5-09be-4d1f-b664-972a7fdd2a71'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 11:57:28.360408 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:57:28.391663 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:57:28.424602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:57:28.430563 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Deleted volume successfully.
Sep 06 11:57:28.562227 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-aed789d5-debd-49d8-8206-69831cdad44d tempest-ServerActionsTestJSON-1249565603 None] Lock "cinder-424f3e42-8c1b-46bf-bef5-aca7d79e7532-delete_volume" released by "delete_volume" :: held 3.781s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 11:57:40.066582 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:57:50.075155 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:58:02.854477 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 11:58:02.855334 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:58:02.884756 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:58:02.917511 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 11:58:10.069545 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:58:20.074704 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:58:40.077359 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:58:50.087357 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:59:10.087932 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:59:30.092339 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:59:40.110859 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 11:59:50.127837 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 11:59:50.147486 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Flow 'volume_create_manager' (8d58fda7-0286-4693-8ef0-beb2f4e3398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:59:50.154531 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a887e59-7259-453e-b5ee-3fd1d3fe8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.170954 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a887e59-7259-453e-b5ee-3fd1d3fe8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T11:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1115103866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b1ace877-72d2-43c8-bc36-8c61db18328a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1282dd54c14401bf4e63d865a67dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T11:59:50Z,use_quota=True,user_id='a4cff140fd1740ff80c13526874a7113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.176218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c713664-79ab-4347-bcd6-80386a52542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.180205 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c713664-79ab-4347-bcd6-80386a52542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.185860 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df047219-b802-481e-b529-4b78a2f44c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.189784 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df047219-b802-481e-b529-4b78a2f44c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ace877-72d2-43c8-bc36-8c61db18328a', 'volume_name': 'volume-b1ace877-72d2-43c8-bc36-8c61db18328a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.194526 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d045d92-289d-41d2-a600-d9a89375e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.198422 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d045d92-289d-41d2-a600-d9a89375e437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.203703 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898a7aee-b384-4580-aa45-caf82eafba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.204774 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Volume b1ace877-72d2-43c8-bc36-8c61db18328a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ace877-72d2-43c8-bc36-8c61db18328a', 'volume_size': 1}
Sep 06 11:59:50.205165 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] creating volume 'volume-b1ace877-72d2-43c8-bc36-8c61db18328a' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 11:59:50.205940 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:59:50.667040 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 11:59:50.667421 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 11:59:50.671661 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898a7aee-b384-4580-aa45-caf82eafba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ace877-72d2-43c8-bc36-8c61db18328a', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.676146 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d56d1fc-2e6d-4fbb-8e12-061180e02486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 11:59:50.775549 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Volume volume-b1ace877-72d2-43c8-bc36-8c61db18328a (b1ace877-72d2-43c8-bc36-8c61db18328a): created successfully
Sep 06 11:59:50.779434 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d56d1fc-2e6d-4fbb-8e12-061180e02486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 11:59:50.784706 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Flow 'volume_create_manager' (8d58fda7-0286-4693-8ef0-beb2f4e3398c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 11:59:50.869222 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-e09e94e1-85f6-4532-950e-e07abaf65e88 tempest-TestMinimumBasicScenario-1042596127 None] Created volume successfully.
Sep 06 11:59:52.324328 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-66390e4d-32b5-4844-83e5-2a0633f25ed9 req-399ebb44-b99a-42c7-93c6-82960e7309a7 tempest-TestMinimumBasicScenario-1042596127 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 11:59:53.148032 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-66390e4d-32b5-4844-83e5-2a0633f25ed9 req-399ebb44-b99a-42c7-93c6-82960e7309a7 tempest-TestMinimumBasicScenario-1042596127 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.823s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 11:59:53.148888 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-66390e4d-32b5-4844-83e5-2a0633f25ed9 req-399ebb44-b99a-42c7-93c6-82960e7309a7 tempest-TestMinimumBasicScenario-1042596127 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b1ace877-72d2-43c8-bc36-8c61db18328a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'b1ace877-72d2-43c8-bc36-8c61db18328a', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 11:59:53.342228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-66390e4d-32b5-4844-83e5-2a0633f25ed9 req-399ebb44-b99a-42c7-93c6-82960e7309a7 tempest-TestMinimumBasicScenario-1042596127 None] Connection info returned from driver {'name': 'volumes/volume-b1ace877-72d2-43c8-bc36-8c61db18328a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b1ace877-72d2-43c8-bc36-8c61db18328a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9059f2f7-11ff-4e6d-ac18-c4ca392be3b8'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 11:59:53.521980 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-66390e4d-32b5-4844-83e5-2a0633f25ed9 req-399ebb44-b99a-42c7-93c6-82960e7309a7 tempest-TestMinimumBasicScenario-1042596127 None] attachment_update completed successfully.
Sep 06 11:59:57.243034 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-59ef94b2-eb76-4ea0-a3bd-d2e631a1d449 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 11:59:58.524135 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-59ef94b2-eb76-4ea0-a3bd-d2e631a1d449 tempest-TestMinimumBasicScenario-1042596127 None] Create snapshot completed successfully
Sep 06 12:00:02.854758 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:00:02.855757 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:00:02.914910 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:00:02.957360 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:00:10.094002 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=25,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:00:20.102051 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:00:50.097901 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:01:00.098220 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:01:02.852556 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:01:02.853203 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:01:02.890530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:01:02.915323 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:01:30.097195 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:01:40.089468 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:01:42.393763 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] Acquiring lock "cinder-679184ee-e745-4e6e-bb38-32a46cbd3f82-delete_snapshot" by "delete_snapshot" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 12:01:42.402681 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-679184ee-e745-4e6e-bb38-32a46cbd3f82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 12:01:42.404309 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:02:00.091560 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:02:02.850858 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:02:02.851561 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:02:02.874768 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:02:02.897564 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:02:10.099141 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:02:13.016616 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] Created reservations ['887d9945-ae0e-4728-ac79-b6edfe8d430b', '545919fd-2745-41f7-8739-f0a01be95cec', 'ac62cf26-1c68-488c-8653-ac9599e8316e', 'b4b520f3-a03c-44de-b4b1-089e773e919e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 12:02:13.167035 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] Delete snapshot completed successfully.
Sep 06 12:02:13.175712 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-24a4da04-72bd-46b5-a015-ff334d9ce523 tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-679184ee-e745-4e6e-bb38-32a46cbd3f82-delete_snapshot" released by "delete_snapshot" :: held 30.769s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 12:02:30.103448 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:02:40.104838 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:03:02.854341 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:03:02.855428 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:03:02.883540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:03:02.909885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:03:10.105735 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:03:10.106405 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:03:28.978781 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-28ec0fe5-0238-4a8e-b51b-50f204c80163 req-e717f8fe-95b9-49ad-aafe-c03fcf654389 tempest-TestMinimumBasicScenario-1042596127 None] Terminate volume connection completed successfully.
Sep 06 12:03:28.979534 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-28ec0fe5-0238-4a8e-b51b-50f204c80163 req-e717f8fe-95b9-49ad-aafe-c03fcf654389 tempest-TestMinimumBasicScenario-1042596127 None] Deleting attachment 9059f2f7-11ff-4e6d-ac18-c4ca392be3b8. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 12:03:29.612676 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Acquiring lock "cinder-b1ace877-72d2-43c8-bc36-8c61db18328a-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 12:03:29.623033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-b1ace877-72d2-43c8-bc36-8c61db18328a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 12:03:29.709152 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:03:29.815926 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 12:03:29.816511 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Volume volume-b1ace877-72d2-43c8-bc36-8c61db18328a is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 12:03:29.874017 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] deleting rbd volume volume-b1ace877-72d2-43c8-bc36-8c61db18328a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 12:03:31.903341 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Created reservations ['5c67da21-ccab-463e-aeb1-f20507c871dc', 'cbe68bc9-55b6-46df-88ab-56d216f2b151', '4bb95d89-b124-429f-92c5-61f43c9521a9', 'fbc29c2b-8135-48f6-93d5-27947294844e'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 12:03:32.057683 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:03:32.082073 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:03:32.107126 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:03:32.111653 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Deleted volume successfully.
Sep 06 12:03:32.186892 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-82ebf574-028e-4636-99b3-ee333f762f1b tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-b1ace877-72d2-43c8-bc36-8c61db18328a-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 12:03:50.114340 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=24,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:03:50.115120 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:04:02.854801 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:04:02.863522 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:04:02.889066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:04:02.925144 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:04:08.750544 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 12:04:08.771049 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Flow 'volume_create_manager' (e3a5f271-7311-406e-b768-02284d471705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 12:04:08.778143 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1252e9-22e9-4e0e-bcb8-fc162fdd84ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:08.794544 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1252e9-22e9-4e0e-bcb8-fc162fdd84ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T12:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-658981231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=47600f94-2570-400a-98ff-86ac42272fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1282dd54c14401bf4e63d865a67dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T12:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T12:04:09Z,use_quota=True,user_id='a4cff140fd1740ff80c13526874a7113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:08.800019 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c601fd-94b8-47b7-aad3-b0521b73319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:08.804213 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c601fd-94b8-47b7-aad3-b0521b73319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:08.809330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790f74c8-c13c-4cac-a8f0-16a99d579696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:08.813419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790f74c8-c13c-4cac-a8f0-16a99d579696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47600f94-2570-400a-98ff-86ac42272fea', 'volume_name': 'volume-47600f94-2570-400a-98ff-86ac42272fea', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:08.818598 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fcce9f-0e6b-41e2-9d67-f2ce17792db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:08.823072 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fcce9f-0e6b-41e2-9d67-f2ce17792db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:08.827656 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17ddbc1-d01b-46bf-8205-37aa1c155d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:08.828729 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Volume 47600f94-2570-400a-98ff-86ac42272fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47600f94-2570-400a-98ff-86ac42272fea', 'volume_size': 1}
Sep 06 12:04:08.829129 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] creating volume 'volume-47600f94-2570-400a-98ff-86ac42272fea' {{(pid=133823) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Sep 06 12:04:08.829901 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:04:09.135429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 12:04:09.135808 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 12:04:09.139473 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17ddbc1-d01b-46bf-8205-37aa1c155d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47600f94-2570-400a-98ff-86ac42272fea', 'volume_size': 1}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:09.143856 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f1169e-8478-4a24-aaf1-34d9e59a4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:04:09.234312 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Volume volume-47600f94-2570-400a-98ff-86ac42272fea (47600f94-2570-400a-98ff-86ac42272fea): created successfully
Sep 06 12:04:09.237811 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f1169e-8478-4a24-aaf1-34d9e59a4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:04:09.243590 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Flow 'volume_create_manager' (e3a5f271-7311-406e-b768-02284d471705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 12:04:09.330755 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-5906b06d-adf5-4eb8-bfae-aa24d582bd2d tempest-TestMinimumBasicScenario-1042596127 None] Created volume successfully.
Sep 06 12:04:10.705303 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-3e3deae0-504c-442b-aa96-21608defc611 req-14647ad1-8b12-4634-af2d-49d30784d431 tempest-TestMinimumBasicScenario-1042596127 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 12:04:11.487968 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-3e3deae0-504c-442b-aa96-21608defc611 req-14647ad1-8b12-4634-af2d-49d30784d431 tempest-TestMinimumBasicScenario-1042596127 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.782s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 12:04:11.488823 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-3e3deae0-504c-442b-aa96-21608defc611 req-14647ad1-8b12-4634-af2d-49d30784d431 tempest-TestMinimumBasicScenario-1042596127 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47600f94-2570-400a-98ff-86ac42272fea', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': '47600f94-2570-400a-98ff-86ac42272fea', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 12:04:11.582841 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-3e3deae0-504c-442b-aa96-21608defc611 req-14647ad1-8b12-4634-af2d-49d30784d431 tempest-TestMinimumBasicScenario-1042596127 None] Connection info returned from driver {'name': 'volumes/volume-47600f94-2570-400a-98ff-86ac42272fea', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '47600f94-2570-400a-98ff-86ac42272fea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5bdc80bb-5b40-4641-ab0a-dca02228fc6a'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 12:04:11.683327 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-3e3deae0-504c-442b-aa96-21608defc611 req-14647ad1-8b12-4634-af2d-49d30784d431 tempest-TestMinimumBasicScenario-1042596127 None] attachment_update completed successfully.
Sep 06 12:04:30.118115 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:04:30.122414 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:05:00.123961 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:05:02.855564 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:05:02.856442 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:05:02.885613 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:05:02.909383 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:05:10.129188 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:05:25.411944 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 req-7b291420-a3ee-4b1d-bc08-171d344950be tempest-TestMinimumBasicScenario-1042596127 None] Terminate volume connection completed successfully.
Sep 06 12:05:25.412592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-da0e4ca0-b5f8-4551-b47d-c9a1977c3d36 req-7b291420-a3ee-4b1d-bc08-171d344950be tempest-TestMinimumBasicScenario-1042596127 None] Deleting attachment 5bdc80bb-5b40-4641-ab0a-dca02228fc6a. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 12:05:26.161164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Acquiring lock "cinder-47600f94-2570-400a-98ff-86ac42272fea-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 12:05:26.171699 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-47600f94-2570-400a-98ff-86ac42272fea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 12:05:26.281214 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:05:26.393711 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 12:05:26.394158 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Volume volume-47600f94-2570-400a-98ff-86ac42272fea is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 12:05:26.452276 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] deleting rbd volume volume-47600f94-2570-400a-98ff-86ac42272fea {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 12:05:28.703053 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Created reservations ['4e49a0b1-152e-403f-99cd-d52b1151b740', '9a1c3b5c-acc7-44d8-a985-ef9c15fafe64', '2be674fc-78ee-4ff5-8f2b-8f80c2f09c67', 'b98a441c-b067-4eb4-a57c-5e6e338f55cf'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 12:05:28.834602 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:05:28.858106 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:05:28.887429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:05:28.893192 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Deleted volume successfully.
Sep 06 12:05:28.953305 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df25c753-b4fb-4386-8315-05f9937140c8 tempest-TestMinimumBasicScenario-1042596127 None] Lock "cinder-47600f94-2570-400a-98ff-86ac42272fea-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 12:05:40.130420 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=22,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:05:50.136641 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:06:00.137477 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:06:02.856091 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:06:02.857491 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:06:02.885645 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:06:02.913874 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:06:30.134363 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:06:40.141161 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:07:02.860473 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:07:02.861168 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:07:02.928989 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:07:02.987551 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:07:10.138119 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:07:10.139100 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:07:30.144210 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:07:40.153560 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:08:02.865035 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:08:02.865857 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:08:02.890429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:08:02.915924 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:08:10.145029 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:08:20.149051 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:08:40.160904 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:08:50.170068 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:09:02.861477 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:09:02.862187 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:09:02.885666 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:09:02.909212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:09:20.155559 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:09:40.160994 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:10:00.154870 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:10:02.864214 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:10:02.864909 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:10:02.893151 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:10:02.921536 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:10:20.154755 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:10:40.168791 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:11:00.151763 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:11:02.866474 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:11:02.867169 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:11:02.892821 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:11:02.920779 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:11:20.153351 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:11:20.154870 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:11:50.150139 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:12:00.146625 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:12:02.865786 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:12:02.866453 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:12:02.890401 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:12:02.921228 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:12:30.153836 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:12:40.166855 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:13:02.867236 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:13:02.867925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:13:02.896239 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:13:02.924799 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:13:10.159432 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:13:20.164211 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:13:40.169195 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:14:00.165405 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:14:00.166023 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:14:02.869751 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:14:02.870419 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:14:02.903409 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:14:02.942540 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:14:10.269178 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:14:30.180517 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:14:50.178698 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:15:00.184419 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:15:02.867766 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:15:02.868466 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:15:02.892226 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:15:02.917109 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:15:30.194128 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:15:40.201369 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:16:02.872234 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:16:02.872936 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:16:02.900910 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:16:02.925893 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:16:10.210798 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:16:20.211541 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:16:30.220412 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:17:00.218285 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:17:02.871079 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:17:02.871803 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:17:02.896506 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:17:02.922330 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:17:20.224286 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:17:30.232735 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:17:50.228973 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:18:00.225327 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:18:02.867661 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:18:02.868340 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:18:02.892530 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:18:02.917108 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:18:10.235774 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:18:16.068182 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Sep 06 12:18:16.088915 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Flow 'volume_create_manager' (8b6a42ec-d8d2-4ec1-aafa-d3fbdae4ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 12:18:16.095487 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d92348-f1b9-4814-9215-3fbf1e890835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:16.111580 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d92348-f1b9-4814-9215-3fbf1e890835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-09-06T12:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1700650001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e98949fac3f403faa6fa0e0c2e86c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-09-06T12:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-09-06T12:18:16Z,use_quota=True,user_id='6394701f1951428995065bf1007c34fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb6e771-fb45-49af-b27f-5df3f7adb754),volume_type_id=7eb6e771-fb45-49af-b27f-5df3f7adb754)' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:16.116914 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355a5874-d698-4696-b049-2d48bec2e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:16.120960 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355a5874-d698-4696-b049-2d48bec2e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:16.126478 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038423b8-4b3f-4549-b827-af3fbebda53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:16.208805 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038423b8-4b3f-4549-b827-af3fbebda53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'volume_name': 'volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7041a910>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:16.213857 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f333fd34-20bb-41ee-a304-ff59d55b0150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:16.217773 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f333fd34-20bb-41ee-a304-ff59d55b0150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:16.222490 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bf4ffb-04a1-4a54-b35d-d092e257044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:16.223620 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Volume f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7041a910>}
Sep 06 12:18:16.224231 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Cloning f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a from image b67f1cec-6cc8-4a81-963d-d6988be4b72f  at location (None, None). {{(pid=133823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Sep 06 12:18:16.224975 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Acquiring lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" by "_prepare_image_cache_entry" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 12:18:16.233897 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 12:18:16.297460 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 12, 18, 16, 238053)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 12:18:16.297907 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 12:18:16.298322 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Found cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Sep 06 12:18:16.303529 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Lock "cinder-b67f1cec-6cc8-4a81-963d-d6988be4b72f" released by "_prepare_image_cache_entry" :: held 0.070s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 12:18:16.304686 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Attempting to retrieve cache entry for image = b67f1cec-6cc8-4a81-963d-d6988be4b72f on host ncdv-master-1@ceph#ceph. {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Sep 06 12:18:16.312066 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Found image-volume cache entry: {'id': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'volume_id': '7bf55cc8-1d8b-4cbb-a608-e052442980c1', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29), 'last_used': datetime.datetime(2022, 9, 6, 12, 18, 16, 308842)}. {{(pid=133823) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Sep 06 12:18:16.312491 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.image.cache [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Image-volume cache entry image_update_at = 2022-09-06 10:41:29+00:00, requested image updated_at = 2022-09-06 10:41:29+00:00. {{(pid=133823) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Sep 06 12:18:16.312894 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Creating from source image-volume 7bf55cc8-1d8b-4cbb-a608-e052442980c1 {{(pid=133823) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Sep 06 12:18:16.324931 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:18:16.465649 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] creating snapshot='volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a.clone_snap' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Sep 06 12:18:17.452792 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] cloning 'volume-7bf55cc8-1d8b-4cbb-a608-e052442980c1@volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a.clone_snap' to 'volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a' {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Sep 06 12:18:18.614795 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Volume volume-459d4725-1cec-496c-b653-8fc2acd7f1d1.deleted is not a clone. {{(pid=133823) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Sep 06 12:18:18.616012 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Sep 06 12:18:18.616396 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133823) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Sep 06 12:18:18.880562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] clone created successfully {{(pid=133823) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Sep 06 12:18:18.880562 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.volume_utils [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Marking volume f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a as bootable. {{(pid=133823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Sep 06 12:18:18.988837 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Copying metadata from image b67f1cec-6cc8-4a81-963d-d6988be4b72f to f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a. {{(pid=133823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Sep 06 12:18:18.989281 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Creating volume glance metadata for volume f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a backed by image b67f1cec-6cc8-4a81-963d-d6988be4b72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Sep 06 12:18:19.144315 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bf4ffb-04a1-4a54-b35d-d092e257044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'volume_size': 1, 'image_id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bd30074e8f6b499db04c6cc2b896adb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'b67f1cec-6cc8-4a81-963d-d6988be4b72f', 'created_at': datetime.datetime(2022, 9, 6, 10, 41, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 9, 6, 10, 41, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b67f1cec-6cc8-4a81-963d-d6988be4b72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8a7041a910>}' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:19.148747 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa18bd06-f137-45c8-8acd-6ecff75f89de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Sep 06 12:18:19.243844 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.flows.manager.create_volume [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Volume volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a (f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a): created successfully
Sep 06 12:18:19.247648 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa18bd06-f137-45c8-8acd-6ecff75f89de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133823) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Sep 06 12:18:19.253628 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Flow 'volume_create_manager' (8b6a42ec-d8d2-4ec1-aafa-d3fbdae4ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133823) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Sep 06 12:18:19.357628 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [None req-df07a4db-c94b-48a4-ba78-2ce0720abf53 tempest-TestShelveInstance-276062557 None] Created volume successfully.
Sep 06 12:18:23.782692 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-05c18ef4-4149-4bd6-b082-a56dd0c3639c req-86e9f5d6-0774-42c5-a3b6-cd3f2677c82e tempest-TestShelveInstance-276062557 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Sep 06 12:18:24.619071 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_concurrency.processutils [req-05c18ef4-4149-4bd6-b082-a56dd0c3639c req-86e9f5d6-0774-42c5-a3b6-cd3f2677c82e tempest-TestShelveInstance-276062557 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.836s {{(pid=133823) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Sep 06 12:18:24.620380 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-05c18ef4-4149-4bd6-b082-a56dd0c3639c req-86e9f5d6-0774-42c5-a3b6-cd3f2677c82e tempest-TestShelveInstance-276062557 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'af92459c-afdf-43ef-b297-c68a15080ce7', 'volume_id': 'f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'discard': True}} {{(pid=133823) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Sep 06 12:18:24.723805 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-05c18ef4-4149-4bd6-b082-a56dd0c3639c req-86e9f5d6-0774-42c5-a3b6-cd3f2677c82e tempest-TestShelveInstance-276062557 None] Connection info returned from driver {'name': 'volumes/volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b0c68f4-ccf2-4763-9cb7-ae9162b44234'} {{(pid=133823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Sep 06 12:18:24.853001 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-05c18ef4-4149-4bd6-b082-a56dd0c3639c req-86e9f5d6-0774-42c5-a3b6-cd3f2677c82e tempest-TestShelveInstance-276062557 None] attachment_update completed successfully.
Sep 06 12:18:40.230390 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=29,cinder:UPDATE=6,cinder:INSERT=5,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:18:40.231981 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=32,cinder:UPDATE=6,cinder:INSERT=7 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:19:02.873270 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:19:02.874130 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:19:02.906569 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:19:02.936415 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:19:10.233752 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:19:20.240251 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:19:40.241204 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:19:50.243717 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:20:02.872601 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:20:02.873359 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:20:02.896138 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:20:02.923162 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:20:20.246893 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:20:30.249037 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:20:50.255702 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:21:02.878115 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:21:02.878790 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:21:02.902339 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:21:02.928592 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:21:10.247659 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:21:30.251279 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:21:40.256110 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:22:02.873751 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:22:02.874467 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:22:02.899216 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:22:02.924048 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:22:10.256734 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:22:16.347510 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:22:16.349973 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-deea8602-7398-4962-9689-931e32af61dd tempest-TestShelveInstance-276062557 None] Terminate volume connection completed successfully.
Sep 06 12:22:16.350388 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.manager [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-deea8602-7398-4962-9689-931e32af61dd tempest-TestShelveInstance-276062557 None] Deleting attachment 0b0c68f4-ccf2-4763-9cb7-ae9162b44234. {{(pid=133823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Sep 06 12:22:16.729748 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Acquiring lock "cinder-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a-delete_volume" by "delete_volume" {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Sep 06 12:22:16.739925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Lock "cinder-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Sep 06 12:22:16.831571 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:22:17.003753 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] volume has no backup snaps {{(pid=133823) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Sep 06 12:22:17.071282 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] deleting rbd volume volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Sep 06 12:22:19.836074 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] volume is a clone so cleaning references {{(pid=133823) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Sep 06 12:22:19.921546 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] deleting parent snapshot volume-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a.clone_snap {{(pid=133823) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Sep 06 12:22:21.937618 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.quota [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Created reservations ['c539a844-002d-4fc9-8cb7-3cb4370921fc', '6b8bdd8b-b917-480d-bb54-215c9a076a8c', '174f7817-d6e6-4b19-b6ab-0dad3bbd7192', '0911c808-5d49-4cf1-8ba5-0d9a9eba9b91'] {{(pid=133823) reserve /opt/stack/cinder/cinder/quota.py:755}}
Sep 06 12:22:22.139965 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:22:22.186982 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:22:22.222925 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:22:22.228768 ncdv-master-1 cinder-volume[133823]: INFO cinder.volume.manager [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Deleted volume successfully.
Sep 06 12:22:22.318655 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.coordination [req-b811f101-c9c1-45fe-a13c-f847af94aeac req-6fdddad6-dcbd-43f7-848a-e35beb4e6432 tempest-TestShelveInstance-276062557 None] Lock "cinder-f0c54ad9-3aae-44e3-9a39-9f04f85e5f9a-delete_volume" released by "delete_volume" :: held 5.579s {{(pid=133823) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Sep 06 12:22:41.839983 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:22:41.840845 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:23:01.844833 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:23:02.870477 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:23:02.871196 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:23:02.895212 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:23:02.924300 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:23:21.849224 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:23:31.855075 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:24:01.846347 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:24:02.869450 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:24:02.870164 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:24:02.893885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:24:02.919801 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:24:11.854400 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:24:31.854357 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:24:51.852272 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:24:51.852967 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:25:02.866588 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:25:02.867348 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:25:02.914639 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:25:02.954972 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:25:31.846704 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:25:31.847674 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:25:51.853493 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:26:02.867804 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:26:02.868538 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:26:02.945263 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:26:02.969346 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:26:11.856778 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:26:31.855957 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:26:51.860243 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:27:02.865277 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:27:02.866033 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:27:02.896328 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:27:02.923163 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:27:11.852606 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:27:21.859587 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:27:31.857116 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:28:01.842634 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:28:01.845087 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:28:02.868844 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:28:02.869509 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:28:02.898671 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:28:02.923421 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:28:41.849621 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:28:41.852132 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:29:02.868953 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:29:02.869716 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:29:02.898771 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:29:02.937651 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:29:21.850930 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:29:21.852486 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:29:51.849244 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:30:01.857090 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:30:02.865564 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:30:02.866541 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:30:02.894166 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:30:02.922345 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:30:21.859206 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:30:41.862752 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:31:01.864038 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:31:02.870062 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:31:02.870740 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:31:02.898967 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:31:02.926364 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:31:21.867467 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:31:41.874450 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:31:41.876345 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:32:02.871722 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:32:02.872426 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:32:02.896333 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:32:02.921089 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:32:21.879880 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:32:21.880550 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:32:41.884067 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:33:01.894374 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:33:02.876980 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:33:02.878623 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:33:02.906343 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:33:02.931747 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:33:11.900763 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:33:31.906226 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:33:51.905515 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:34:02.877902 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:34:02.878668 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:34:02.902885 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:34:02.928145 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:34:11.902472 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:34:31.900566 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:34:51.900781 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:35:02.874519 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:35:02.875218 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:35:02.897957 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:35:02.921944 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 06 12:35:11.901042 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=1 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:35:11.901701 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:35:41.912712 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:35:51.904651 ncdv-master-1 cinder-volume[133823]: DEBUG dbcounter [-] [133823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Sep 06 12:36:02.878287 ncdv-master-1 cinder-volume[133823]: DEBUG oslo_service.periodic_task [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133823) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Sep 06 12:36:02.879429 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:36:02.906016 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.volume.drivers.rbd [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133823) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Sep 06 12:36:02.932662 ncdv-master-1 cinder-volume[133823]: DEBUG cinder.manager [None req-821aef32-18fb-49f4-ac73-a4a6bd815088 None None] Notifying Schedulers of capabilities ... {{(pid=133823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}