-- Logs begin at Sat 2022-10-08 20:01:32 UTC, end at Sat 2022-10-08 22:26:55 UTC. --
Oct 08 20:41:56.155502 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Oct 08 20:41:59.336515 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=133174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Oct 08 20:41:59.337492 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=133174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}}
Oct 08 20:41:59.337492 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=133174) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}}
Oct 08 20:41:59.758871 ncdv-master-1 cinder-volume[133174]: INFO dbcounter [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Registered counter for database cinder
Oct 08 20:41:59.777822 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_db.sqlalchemy.engines [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Oct 08 20:41:59.784244 ncdv-master-1 cinder-volume[133174]: DEBUG dbcounter [-] [133174] Writer thread running {{(pid=133174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Oct 08 20:42:00.077258 ncdv-master-1 cinder-volume[133174]: INFO cinder.rpc [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Oct 08 20:42:00.082292 ncdv-master-1 cinder-volume[133174]: INFO cinder.rpc [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Oct 08 20:42:00.091455 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_db.sqlalchemy.engines [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Oct 08 20:42:00.163268 ncdv-master-1 cinder-volume[133174]: INFO cinder.volume.manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Determined volume DB was empty at startup.
Oct 08 20:42:00.164060 ncdv-master-1 cinder-volume[133174]: DEBUG cinder.volume.manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=133174) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Oct 08 20:42:00.174460 ncdv-master-1 cinder-volume[133174]: INFO cinder.volume.manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Service not found for updating active_backend_id, assuming default for driver init.
Oct 08 20:42:00.175420 ncdv-master-1 cinder-volume[133174]: WARNING stevedore.named [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Oct 08 20:42:00.176058 ncdv-master-1 cinder-volume[133174]: WARNING castellan.key_manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 08 20:42:00.177564 ncdv-master-1 cinder-volume[133174]: WARNING cinder.keymgr.conf_key_mgr [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 08 20:42:00.196944 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_db.sqlalchemy.engines [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Oct 08 20:42:00.201884 ncdv-master-1 cinder-volume[133174]: INFO cinder.rpc [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Oct 08 20:42:00.206538 ncdv-master-1 cinder-volume[133174]: INFO cinder.rpc [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Oct 08 20:42:00.207300 ncdv-master-1 cinder-volume[133174]: WARNING stevedore.named [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Oct 08 20:42:00.207804 ncdv-master-1 cinder-volume[133174]: WARNING castellan.key_manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 08 20:42:00.209697 ncdv-master-1 cinder-volume[133174]: INFO cinder.volume.manager [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Oct 08 20:42:00.216059 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_db.sqlalchemy.engines [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Oct 08 20:42:00.237847 ncdv-master-1 cinder-volume[133174]: INFO oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Starting 1 workers
Oct 08 20:42:00.243161 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Started child 133344 {{(pid=133174) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Oct 08 20:42:00.244498 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Full set of CONF: {{(pid=133174) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Oct 08 20:42:00.244853 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ******************************************************************************** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Oct 08 20:42:00.245339 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] Configuration options gathered from: {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Oct 08 20:42:00.245849 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Oct 08 20:42:00.246642 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Oct 08 20:42:00.247085 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ================================================================================ {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Oct 08 20:42:00.247972 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] allow_availability_zone_fallback = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.248577 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] allow_compression_on_image_upload = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.249026 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] allowed_direct_url_schemes     = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.249638 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] api_rate_limit                 = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.250815 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] auth_strategy                  = keystone {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.251261 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] az_cache_duration              = 3600 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.251393 ncdv-master-1 cinder-volume[133344]: INFO cinder.service [-] Starting cinder-volume node (version 21.1.0)
Oct 08 20:42:00.251875 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_availability_zone      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.252030 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_host                   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.252454 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_name                   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.252861 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_stats_polling_interval = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.253288 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backup_api_class               = cinder.backup.api.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.253665 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.254072 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backup_name_template           = backup-%s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.254557 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backup_use_same_host           = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.254863 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backup_use_temp_snapshot       = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.255243 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] chap_password                  = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.255603 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] chap_username                  =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.255992 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.256420 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_internal_tenant_project_id = 1ba1e9ad05694bbe8723c14f5e2b08f7 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.256807 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_internal_tenant_user_id = 7885df3b2ae34969852f76fbc94a7a10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.257195 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cloned_volume_same_az          = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.257564 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cluster                        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.257940 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] compression_format             = gzip {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.258364 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] compute_api_class              = cinder.compute.nova.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.258796 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] config_dir                     = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.259091 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.259483 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] config_source                  = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.259842 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.260241 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] control_exchange               = openstack {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.260669 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] debug                          = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.261037 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] default_availability_zone      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.261405 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] default_group_type             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.261960 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.263579 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] default_volume_type            = ceph {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.263915 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_client_cert             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.264425 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_client_cert_key         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.264940 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_data_namespace          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.265545 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_ssl_cert_path           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.266140 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_ssl_cert_verify         = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.266643 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] driver_use_ssl                 = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.267177 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] enable_force_upload            = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.267691 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] enable_new_services            = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.268201 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] enable_unsupported_driver      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.268741 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] enabled_backends               = ['ceph'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.269293 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] enforce_multipath_for_image_xfer = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.269806 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] filter_function                = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.270381 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_api_insecure            = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.270726 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_api_servers             = ['http://10.222.0.26/image'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.271215 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_api_ssl_compression     = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.271697 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_ca_certificates_file    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.272254 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_catalog_info            = image:glance:publicURL {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.272785 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_certfile                = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.273303 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.273673 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_keyfile                 = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.274032 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_num_retries             = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.274394 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] glance_request_timeout         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.274735 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] goodness_function              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.275114 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] graceful_shutdown_timeout      = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.275462 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] group_api_class                = cinder.group.api.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.275758 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] host                           = ncdv-master-1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.276132 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.276535 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_compress_on_upload       = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.276934 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_conversion_address_space_limit = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.277287 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_conversion_cpu_limit     = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.277830 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.278174 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_conversion_disable       = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.278532 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_upload_use_cinder_backend = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.278874 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_upload_use_internal_tenant = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.279239 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_volume_cache_enabled     = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.279598 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_volume_cache_max_count   = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.279996 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] image_volume_cache_max_size_gb = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.280347 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] init_host_max_objects_retrieval = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.280700 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] instance_format                = [instance: %(uuid)s]  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.281707 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.282319 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iscsi_iotype                   = fileio {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iscsi_secondary_ip_addresses   = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iscsi_target_flags             =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iscsi_write_cache              = on {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iser_helper                    = tgtadm {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iser_ip_address                = 10.222.0.26 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.285398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iser_port                      = 3260 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_config_append              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_dir                        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_file                       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_options                    = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.287929 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_rotate_interval            = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.288042 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_rotate_interval_type       = days {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.288407 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] log_rotation_type              = none {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.288699 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.288993 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.289385 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.289742 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.290100 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.290481 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] max_age                        = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.290845 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] max_logfile_count              = 30 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.291213 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] max_logfile_size_mb            = 200 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.291629 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] max_over_subscription_ratio    = 20.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.292017 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] message_reap_interval          = 86400 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.292366 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] message_ttl                    = 2592000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.292737 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] migration_create_volume_timeout_secs = 300 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.293081 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] monkey_patch                   = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.293478 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] monkey_patch_modules           = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.293769 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] my_ip                          = 10.222.0.26 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.294136 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] no_snapshot_gb_quota           = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.294472 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] num_iser_scan_tries            = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.294840 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] num_shell_tries                = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.295182 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] num_volume_device_scan_tries   = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.295436 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Starting volume driver RBDDriver (1.3.0)
Oct 08 20:42:00.295558 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] nvmet_ns_id                    = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.295876 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] nvmet_port_id                  = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.296271 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_max_limit                = 1000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.296639 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_ext_list          = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.297694 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.297954 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.298478 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.298994 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_listen_port       = 8776 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.299489 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_use_ssl           = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.300003 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] osapi_volume_workers           = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.300513 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] per_volume_size_limit          = -1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.300851 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] periodic_fuzzy_delay           = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.301383 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] periodic_interval              = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.302367 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.302367 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] public_endpoint                = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.302624 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] publish_errors                 = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.303209 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_backup_gigabytes         = 1000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.303720 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_backups                  = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.304256 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_consistencygroups        = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.304782 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.305290 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_gigabytes                = 1000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.305803 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_groups                   = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.306302 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_snapshots                = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.306821 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] quota_volumes                  = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.307320 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] rate_limit_burst               = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.307846 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] rate_limit_except_level        = CRITICAL {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.308355 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] rate_limit_interval            = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.308867 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] reinit_driver_count            = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.309408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] replication_device             = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.309899 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] report_discard_supported       = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.310395 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] report_interval                = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.310979 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] reservation_clean_interval     = 86400 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.311422 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] reservation_expire             = 86400 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.311912 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] reserved_percentage            = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.312469 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.312979 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.313623 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] rpc_response_timeout           = 120 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.314073 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] run_external_periodic_tasks    = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.314330 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.314687 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] scst_target_driver             = iscsi {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.315027 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] scst_target_iqn_name           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.315317 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_down_time              = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.315738 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] snapshot_name_template         = snapshot-%s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.316101 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] snapshot_same_host             = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.316449 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] split_loggers                  = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.316740 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] state_path                     = /opt/stack/data/cinder {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.317097 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] storage_availability_zone      = nova {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.317496 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] storage_protocol               = iSCSI {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.317861 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] syslog_log_facility            = LOG_USER {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.318219 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] target_helper                  = lioadm {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.318661 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] target_ip_address              = 10.222.0.26 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.319029 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] target_port                    = 3260 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.319388 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.319764 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] target_protocol                = iscsi {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.320111 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] trace_flags                    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.320469 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.320843 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] transport_url                  = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.321263 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] until_refresh                  = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.321627 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_chap_auth                  = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.321969 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_default_quota_class        = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.322345 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_eventlog                   = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.322719 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_journal                    = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.323080 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_json                       = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.323428 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_multipath_for_image_xfer   = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.323772 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_stderr                     = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.324131 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] use_syslog                     = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.324523 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] verify_glance_signatures       = enabled {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.324914 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_api_class               = cinder.volume.api.API {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.325359 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_backend_name            = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.325747 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_clear                   = zero {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.326096 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_clear_ionice            = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.326476 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_clear_size              = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.326932 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.329141 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_copy_bps_limit          = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.330025 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_dd_blocksize            = 1M {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.330568 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.331085 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_name_template           = volume-%s {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.331594 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_service_inithost_offload = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.332140 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volume_usage_audit_period      = month {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.332869 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.333408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] watch_log_file                 = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.333928 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] zoning_mode                    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 08 20:42:00.334556 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.335142 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.335689 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.336268 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_concurrency.disable_process_locking = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.336792 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.337943 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.338454 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.338984 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.341326 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.341860 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.342457 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.admin_password = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.342972 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.343470 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.admin_token = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.344467 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.admin_user  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.345016 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.345600 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.346152 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_port   = 35357 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.346688 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_protocol = https {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.347253 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_section = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.347775 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_type   = password {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.348306 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_uri    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.348800 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.auth_version = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.349340 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.cache       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.351353 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.351868 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.certfile    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.352394 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.delay_auth_decision = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.352954 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.353482 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.http_connect_timeout = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.354005 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.354508 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.identity_uri = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.355025 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.include_service_catalog = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.355524 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.insecure    = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.356031 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.interface   = public {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.356527 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.keyfile     = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.357035 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.357964 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.358839 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.359897 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.360409 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.360905 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.361459 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.361779 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.362285 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.362850 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.363351 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.region_name = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.363881 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.364474 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.service_token_roles_required = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.364973 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.service_type = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.365522 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.token_cache_time = 300 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.366054 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.366638 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.backend                  = dogpile.cache.null {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.367178 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.backend_argument         = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.367702 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.config_prefix            = cache.oslo {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.368295 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.dead_timeout             = 60.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.368816 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.debug_cache_backend      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.369387 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.enable_retry_client      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.369900 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.enable_socket_keepalive  = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.370404 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.enabled                  = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.370925 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.expiration_time          = 600 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.371432 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.hashclient_retry_attempts = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.371919 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.372442 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_dead_retry      = 300 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.372961 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_password        =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.373523 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.374061 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.374570 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_pool_maxsize    = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.375110 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.375609 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_sasl_enabled    = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.376152 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.376672 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.377209 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.memcache_username        =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.377752 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.proxies                  = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.378272 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.retry_attempts           = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.378781 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.retry_delay              = 0.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.379273 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.socket_keepalive_count   = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.379781 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.socket_keepalive_idle    = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.380292 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.socket_keepalive_interval = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.380779 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.tls_allowed_ciphers      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.381305 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.tls_cafile               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.381820 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.tls_certfile             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.382311 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.tls_enabled              = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.382852 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cache.tls_keyfile              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.383382 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] coordination.backend_url       = etcd3+http://10.222.0.26:2379 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.383962 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.backend               = sqlalchemy {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.384428 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.connection            = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.384969 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.connection_debug      = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.385515 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.connection_parameters =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.386044 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.connection_recycle_time = 3600 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.387833 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.connection_trace      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.388516 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.db_inc_retry_interval = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.389453 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.db_max_retries        = 20 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.390216 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.db_max_retry_interval = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.390754 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.db_retry_interval     = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.391263 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.max_overflow          = 50 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.391893 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.max_pool_size         = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.392423 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.max_retries           = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.392929 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.mysql_enable_ndb      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.393489 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.393995 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.pool_timeout          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.394501 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.retry_interval        = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.395020 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.slave_connection      = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.396088 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.sqlite_synchronous    = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.397020 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] database.use_db_reconnect      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.397587 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.enforce_new_defaults = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.398099 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.enforce_scope      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.398639 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.policy_default_rule = default {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.399196 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.399748 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.policy_file        = policy.yaml {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.400291 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.400792 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.401380 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.403643 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.404546 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.405137 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.connection_string     = messaging:// {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.405618 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.enabled               = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.406682 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.es_doc_type           = notification {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.407240 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.es_scroll_size        = 10000 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.407752 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.es_scroll_time        = 2m {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.408253 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.filter_error_trace    = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.408792 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.409334 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.sentinel_service_name = mymaster {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.410143 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.socket_timeout        = 0.1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.410648 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] profiler.trace_sqlalchemy      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.411204 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.capabilities   = [21] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.411727 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.group          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.412242 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.helper_command = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.412759 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.413296 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.413818 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] privsep_osbrick.user           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.414387 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.414895 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.group         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.415406 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.helper_command = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.415906 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.416408 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.417519 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] cinder_sys_admin.user          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.418045 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.auth_section      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.418560 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.auth_type         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.419064 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.cafile            = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.419566 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.certfile          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.420091 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.collect_timing    = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.420594 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.insecure          = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.421093 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.keyfile           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.422237 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.send_service_user_token = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.422762 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.split_loggers     = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.423277 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] service_user.timeout           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.423865 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.backend_availability_zone = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.424382 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.424895 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.425444 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.chap_password = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.425964 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.chap_username =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.426491 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.427013 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.427527 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.428040 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_client_cert = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.428541 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_client_cert_key = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.429044 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_data_namespace = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.429576 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.430087 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.430688 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.driver_use_ssl = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.431192 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.enable_deferred_deletion = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.431719 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.enable_unsupported_driver = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.432236 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.432742 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.extra_capabilities = {} {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.433271 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.filter_function = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.433806 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.goodness_function = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.434324 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.434819 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.435302 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.435794 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.436306 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.436819 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.437442 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.437954 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.438461 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iscsi_target_flags =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.438979 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iscsi_write_cache = on {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.439495 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iser_helper   = tgtadm {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.440170 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iser_ip_address = 10.222.0.26 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.440679 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iser_port     = 3260 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.441237 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.441751 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.442269 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.442798 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.num_shell_tries = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.443302 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.443827 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.444352 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.nvmet_port_id = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.444899 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.445552 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rados_connection_interval = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.446099 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rados_connection_retries = 3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.446628 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_ceph_conf =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.447284 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.447805 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.448431 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.448966 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.449499 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_pool      = rbd {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.450016 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_secret_uuid = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.450521 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.451030 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.rbd_user      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.451550 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.452055 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.replication_device = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.452564 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.report_discard_supported = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.452977 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.453361 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.reserved_percentage = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.453730 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.scst_target_driver = iscsi {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.454246 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.scst_target_iqn_name = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.454614 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.storage_protocol = iSCSI {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.454965 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.455502 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.target_helper = tgtadm {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.455998 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.target_ip_address = 10.222.0.26 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.456365 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.target_port   = 3260 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.456731 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.457093 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.target_protocol = iscsi {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.457478 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.trace_flags   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.457829 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.unique_fqdn_network = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.458180 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.use_chap_auth = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.458527 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.458870 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_backend_name = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.459230 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_clear  = zero {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.459582 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_clear_ionice = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.459930 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_clear_size = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.460290 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.461440 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.461806 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.462176 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.462636 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.463194 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_reports.file_event_handler = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.463588 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.463945 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_reports.log_dir           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.464339 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.backend_availability_zone = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.464682 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.backend_host              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.465033 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.backend_native_threads_pool_size = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.465424 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.backup_use_temp_snapshot  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.465765 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.chap_password             = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.466109 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.chap_username             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.466461 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.chiscsi_conf              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.466802 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.deferred_deletion_delay   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.467143 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.deferred_deletion_purge_interval = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.467486 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_client_cert        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.467851 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_client_cert_key    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.468192 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_data_namespace     = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.469064 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_ssl_cert_path      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.469466 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_ssl_cert_verify    = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.469831 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.driver_use_ssl            = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.470172 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.enable_deferred_deletion  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.470594 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.enable_unsupported_driver = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.470938 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.471519 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.extra_capabilities        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.471986 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.filter_function           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.472417 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.goodness_function         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.472761 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iet_conf                  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.473107 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.image_upload_use_cinder_backend = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.473773 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.image_upload_use_internal_tenant = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.474482 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.image_volume_cache_enabled = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.475005 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.image_volume_cache_max_count = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.475521 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.476053 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iscsi_iotype              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.476574 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.477110 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iscsi_target_flags        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.477655 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iscsi_write_cache         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.478194 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iser_helper               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.478730 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iser_ip_address           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.479278 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iser_port                 = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.479810 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.iser_target_prefix        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.480332 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.max_over_subscription_ratio = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.481547 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.num_iser_scan_tries       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.481910 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.num_shell_tries           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.482265 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.num_volume_device_scan_tries = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.482617 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.nvmet_ns_id               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.482969 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.nvmet_port_id             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.483340 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rados_connect_timeout     = -1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.483945 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rados_connection_interval = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.484840 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rados_connection_retries  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.485222 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.485591 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_cluster_name          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.486161 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.486771 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.487372 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_max_clone_depth       = 5 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.487950 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_pool                  = volumes {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.488525 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_secret_uuid           = c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.491901 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_store_chunk_size      = 4 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.492365 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.rbd_user                  = cinder {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.492810 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.replication_connect_timeout = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.493279 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.replication_device        = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.493713 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.report_discard_supported  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.494133 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.report_dynamic_total_capacity = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.494553 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.reserved_percentage       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.494972 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.scst_target_driver        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.495409 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.scst_target_iqn_name      = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.495826 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.storage_protocol          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.496249 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.496662 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.target_helper             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.497080 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.target_ip_address         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.497516 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.target_port               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.497928 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.target_prefix             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.498348 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.target_protocol           = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.498760 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.trace_flags               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.499194 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.unique_fqdn_network       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.500004 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.use_chap_auth             = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.500432 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.use_multipath_for_image_xfer = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.500859 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_backend_name       = ceph {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.501381 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_clear              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.501794 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_clear_ionice       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.502204 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_clear_size         = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.502636 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.503049 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_copy_bps_limit     = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.503456 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_dd_blocksize       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.503880 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.504289 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ceph.volumes_dir               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.504790 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.505284 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.505727 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.506158 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.506612 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.507043 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.507485 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.507904 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.508317 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.508750 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.509209 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.509778 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.510346 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.510767 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.511183 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.511638 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.512054 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.512473 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.513118 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.513511 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.513937 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.514359 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.514775 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.515220 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.515666 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.516112 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl      = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.516550 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.516983 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.517426 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.517852 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.518291 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.518680 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_notifications.driver = [] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.519137 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_notifications.retry = -1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.519627 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.520216 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] oslo_messaging_notifications.transport_url = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.520619 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.520974 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] key_manager.fixed_key          = **** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.521500 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.521928 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.barbican_api_version  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.522356 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.barbican_endpoint     = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.522815 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.barbican_endpoint_type = public {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.523238 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.barbican_region_name  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.523643 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.cafile                = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.524046 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.certfile              = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.524477 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.collect_timing        = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.524653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.524962 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.insecure              = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.525393 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.keyfile               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.525803 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.number_of_retries     = 60 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.526223 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.retry_delay           = 1 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.526658 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.send_service_user_token = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.527066 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.split_loggers         = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.527474 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.timeout               = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.527885 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.verify_ssl            = True {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.528290 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican.verify_ssl_path       = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.528719 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.auth_section = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.529145 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.auth_type = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.529575 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.cafile   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.530162 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.certfile = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.530572 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.collect_timing = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.531524 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.insecure = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.531931 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.keyfile  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.532340 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.split_loggers = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.532746 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] barbican_service_user.timeout  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.533195 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.approle_role_id          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.533596 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.approle_secret_id        = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.534135 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.cafile                   = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.534737 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.certfile                 = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.535229 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.collect_timing           = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.535724 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.insecure                 = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.536232 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.keyfile                  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.536753 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.kv_mountpoint            = secret {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.537355 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.kv_version               = 2 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.537857 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.namespace                = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.538384 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.root_token_id            = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.538895 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.split_loggers            = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.539398 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.ssl_ca_crt_file          = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.539887 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.timeout                  = None {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.540560 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.use_ssl                  = False {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.541078 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 08 20:42:00.541542 ncdv-master-1 cinder-volume[133174]: DEBUG oslo_service.service [None req-986fa0e9-7517-45cf-99ed-6d2e95b67349 None None] ******************************************************************************** {{(pid=133174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Oct 08 20:42:00.573178 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.driver [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Driver hasn't implemented _init_vendor_properties()
Oct 08 20:42:00.573743 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.driver [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f438dab4-bd55-4179-95aa-b7d3f1d6edb3:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133344) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Oct 08 20:42:00.588326 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Oct 08 20:42:00.590805 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writer thread running {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Oct 08 20:42:00.625836 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.db.sqlalchemy.api [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Building query based on filter {{(pid=133344) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Oct 08 20:42:00.660468 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=133344) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Oct 08 20:42:00.667740 ncdv-master-1 cinder-volume[133344]: INFO cinder.keymgr.migration [None req-ae733227-20fe-4a58-99ba-7b103ab0d6eb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Oct 08 20:42:00.677206 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.713123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.744771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:42:00.781251 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Driver initialization completed successfully.
Oct 08 20:42:00.781251 ncdv-master-1 cinder-volume[133344]: INFO cinder.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Initiating service 3 cleanup
Oct 08 20:42:00.782171 ncdv-master-1 cinder-volume[133344]: INFO cinder.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Service 3 cleanup completed.
Oct 08 20:42:00.782497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.service [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Creating RPC server for service cinder-volume {{(pid=133344) start /opt/stack/cinder/cinder/service.py:238}}
Oct 08 20:42:00.790956 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.service [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=133344) start /opt/stack/cinder/cinder/service.py:244}}
Oct 08 20:42:00.832331 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Initializing RPC dependent components of volume driver RBDDriver (1.3.0)
Oct 08 20:42:00.833401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.871457 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:42:00.923556 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fd8864c8-0574-4802-a7e6-a1c9b7ec496e None None] Driver post RPC initialization completed successfully.
Oct 08 20:42:10.227933 ncdv-master-1 cinder-volume[133174]: DEBUG dbcounter [-] [133174] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=133174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:42:10.907011 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=25,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:42:10.918080 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:42:30.928496 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:42:40.936878 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:43:00.942989 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:43:05.927375 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:43:05.928085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:43:05.951388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:43:05.975859 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:43:10.947593 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:43:30.945301 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:43:40.950625 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:44:00.954153 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:44:05.930890 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:44:05.931541 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:44:05.955036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:44:05.978295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:44:10.957725 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:44:30.959181 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:44:50.966443 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:45:05.935372 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:45:05.936382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:45:05.964086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:45:05.988701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:45:10.974004 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:45:20.977782 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:45:30.988457 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:45:50.986909 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:46:00.994184 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:46:05.935013 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:46:05.935652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:46:05.958530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:46:05.980702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:46:20.998543 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:46:21.000310 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:46:41.006763 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:46:51.009501 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:47:01.019751 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:47:05.936248 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:47:05.936882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:47:05.960808 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:47:05.985821 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:47:21.019393 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:47:41.025654 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:47:51.029150 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:48:05.940876 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:48:05.941557 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:48:05.963476 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:48:05.985704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:48:11.036115 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:48:21.040021 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:48:41.046694 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:49:01.052256 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:49:05.941020 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:49:05.943033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:49:05.965084 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:49:05.987252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:49:11.061678 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:49:31.062670 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:49:41.071325 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:50:01.071082 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:50:05.942691 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:50:05.943363 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:50:05.974273 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:50:05.996669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:50:11.081881 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:50:31.082781 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:50:31.083462 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:50:51.090513 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:51:11.090870 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:51:11.098530 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:51:31.098825 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:51:41.106944 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:52:01.108981 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:52:05.942649 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:52:05.943779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:52:05.986317 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:52:06.028869 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:52:21.100947 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:52:41.103426 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:52:41.106410 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:53:05.946037 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:53:05.946766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:53:06.019681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:53:06.086586 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:53:21.105967 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:53:21.106611 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:53:41.122051 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:54:01.115870 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:54:05.942172 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:54:05.942969 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:54:06.027266 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:54:06.093931 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:54:21.113985 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:54:41.118611 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:55:01.119057 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:55:05.945499 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:55:05.946055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:06.005007 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:06.103612 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:55:15.876198 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:55:16.007663 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (f5f721b0-c435-41af-bb57-91777f670f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:16.017022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607e4dc5-1fbe-46b8-8aac-11fb72921449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:16.078488 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607e4dc5-1fbe-46b8-8aac-11fb72921449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-727480028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51fae793a147d88e5d956352f18b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:55:16Z,use_quota=True,user_id='bc0c5c9593754f1cb98f9689b29606a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:16.088738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df02f78-a9bf-40c1-823c-1ac9bb2a091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:16.094484 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df02f78-a9bf-40c1-823c-1ac9bb2a091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:16.101599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2b4375-251d-4846-8e22-ddefca8ab6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:16.268355 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2b4375-251d-4846-8e22-ddefca8ab6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'volume_name': 'volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b575670>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:16.282150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1ca5d6-971a-445a-96e9-6e80c43fc3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:16.292998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1ca5d6-971a-445a-96e9-6e80c43fc3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:16.308111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66c4807-4874-41f7-baf5-e1cfde36ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:16.310412 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b575670>}
Oct 08 20:55:16.311271 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Cloning b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 20:55:16.315055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:55:16.337068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:55:16.358341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Preparing cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}}
Oct 08 20:55:16.361757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 20:55:21.152708 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:55:32.237861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph, size 616.00 MB, duration 15.86 sec {{(pid=133344) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Oct 08 20:55:32.239020 ncdv-master-1 cinder-volume[133344]: INFO cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Image download 616.00 MB at 38.83 MB/s
Oct 08 20:55:32.295499 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:32.539175 ncdv-master-1 sudo[145974]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph
Oct 08 20:55:32.540059 ncdv-master-1 sudo[145974]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:34.443208 ncdv-master-1 sudo[145974]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:34.445588 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph" returned: 0 in 2.150s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:34.446436 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Temporary image c508bd7f-7db9-4b2c-af7c-be54a855c355 is fetched for user bc0c5c9593754f1cb98f9689b29606a2. {{(pid=133344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Oct 08 20:55:34.544165 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:55:34.606724 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:34.795881 ncdv-master-1 sudo[145997]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph
Oct 08 20:55:34.802284 ncdv-master-1 sudo[145997]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:36.210071 ncdv-master-1 sudo[145997]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:36.213652 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph" returned: 0 in 1.605s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:36.213652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] creating volume 'volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 20:55:36.222768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:36.427498 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:55:36.427961 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:55:36.467941 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Attempting download of c508bd7f-7db9-4b2c-af7c-be54a855c355 ((None, None)) to volume b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21. {{(pid=133344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Oct 08 20:55:36.530737 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c508bd7f-7db9-4b2c-af7c-be54a855c355_wp_54tbn {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:36.704726 ncdv-master-1 sudo[146029]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c508bd7f-7db9-4b2c-af7c-be54a855c355_wp_54tbn
Oct 08 20:55:36.706650 ncdv-master-1 sudo[146029]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:38.382550 ncdv-master-1 sudo[146029]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:38.384726 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_c508bd7f-7db9-4b2c-af7c-be54a855c355_wp_54tbn" returned: 0 in 1.854s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:38.386843 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:38.615170 ncdv-master-1 sudo[146042]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph
Oct 08 20:55:38.622201 ncdv-master-1 sudo[146042]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:40.843948 ncdv-master-1 sudo[146042]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:40.847043 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph" returned: 0 in 2.460s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:40.848362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] c508bd7f-7db9-4b2c-af7c-be54a855c355 was vhdx, converting to raw {{(pid=133344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Oct 08 20:55:40.851189 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa_me0nbc {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:40.881648 ncdv-master-1 sudo[146083]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa_me0nbc
Oct 08 20:55:40.882479 ncdv-master-1 sudo[146083]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:44.189152 ncdv-master-1 sudo[146083]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:44.191405 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpa_me0nbc" returned: 0 in 3.341s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:44.192178 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:44.367626 ncdv-master-1 sudo[146124]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph
Oct 08 20:55:44.373802 ncdv-master-1 sudo[146124]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 08 20:55:46.329655 ncdv-master-1 sudo[146124]: pam_unix(sudo:session): session closed for user root
Oct 08 20:55:46.331928 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph" returned: 0 in 2.139s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:46.332859 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c508bd7f-7db9-4b2c-af7c-be54a855c355_19k12ooincdv-master-1@ceph, size 700.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/conversion/tmpa_me0nbc {{(pid=133344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Oct 08 20:55:46.333289 ncdv-master-1 cinder-volume[133344]: INFO cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Converted 700.00 MB image at 209.44 MB/s
Oct 08 20:55:46.334649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:46.489917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 20:55:46.501948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:55:46.529744 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] deleting rbd volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 20:55:46.962591 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpa_me0nbc volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:55:54.457358 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpa_me0nbc volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 7.495s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:55:54.683603 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:54.861173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:55:54.861654 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:55:54.862304 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Downloaded image c508bd7f-7db9-4b2c-af7c-be54a855c355 ((None, None)) to volume b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 successfully. {{(pid=133344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Oct 08 20:55:54.960762 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Temporary image c508bd7f-7db9-4b2c-af7c-be54a855c355 for user bc0c5c9593754f1cb98f9689b29606a2 is deleted. {{(pid=133344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Oct 08 20:55:55.000528 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:55:55.207586 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 08 20:55:55.214221 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 08 20:55:55.381146 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Created reservations ['c08384a3-58af-4284-8d09-e61eb85afbb9', '5b41f327-b968-4cf4-9520-e87e06276caa', '9ee2297d-fd7d-4eda-ab97-2e8fb5623704', '505f18e1-998d-4ceb-98c1-9ffc3527b40d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 20:55:55.397778 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Creating image volume entry: {'scheduled_at': datetime.datetime(2022, 10, 8, 20, 55, 16, tzinfo=datetime.timezone.utc), 'provider_auth': None, 'group_id': None, 'user_id': 'bc0c5c9593754f1cb98f9689b29606a2', 'display_description': None, 'metadata': {}, 'provider_id': None, 'shared_targets': True, 'provider_geometry': None, 'size': 1, 'provider_location': None, 'replication_driver_data': None, 'replication_status': None, 'launched_at': None, 'deleted': False, 'replication_extended_status': None, 'updated_at': datetime.datetime(2022, 10, 8, 20, 55, 16, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'project_id': '1ba1e9ad05694bbe8723c14f5e2b08f7', 'ec2_id': None, 'display_name': 'image-c508bd7f-7db9-4b2c-af7c-be54a855c355', 'consistencygroup_id': None, 'volume_admin_metadata': [], 'cluster_name': None, 'service_uuid': None, 'created_at': datetime.datetime(2022, 10, 8, 20, 55, 15, tzinfo=datetime.timezone.utc), 'bootable': False, 'multiattach': False, 'host': 'ncdv-master-1@ceph#ceph', 'terminated_at': None, 'previous_status': None, 'deleted_at': None, 'volume_type_id': 'e86e7727-83c5-4750-ab26-4096887cb782', 'volume_metadata': [], 'availability_zone': 'nova', 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21'}. {{(pid=133344) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}}
Oct 08 20:55:55.567362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume reschedule parameters: False retry: None {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:55:55.615068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (7263043b-21d6-4eb7-b26a-7b1bcba1d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:55.629073 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbfdf07-b7ed-4f53-b8b5-b749fc599e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:55.665181 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbfdf07-b7ed-4f53-b8b5-b749fc599e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c508bd7f-7db9-4b2c-af7c-be54a855c355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=75bc1a74-4c1d-4a8b-bacf-00463fd6604f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba1e9ad05694bbe8723c14f5e2b08f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21,status='creating',terminated_at=None,updated_at=2022-10-08T20:55:16Z,use_quota=True,user_id='bc0c5c9593754f1cb98f9689b29606a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:55.673706 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3888b337-0a1f-49c9-9873-5027013464cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:55.679081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3888b337-0a1f-49c9-9873-5027013464cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:55.687335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f429be-690f-4404-84f7-c9e6ab2b57e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:55.710497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f429be-690f-4404-84f7-c9e6ab2b57e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'volume_name': 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'volume_size': 1, 'source_volid': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'source_volstatus': 'downloading'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:55.734520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaa64dd-985c-41a7-8f03-e33479933b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:55.741460 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaa64dd-985c-41a7-8f03-e33479933b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:55.747905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a0385-58c1-4428-93da-d223194484b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:55.749638 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'volume_size': 1, 'source_volid': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'source_volstatus': 'downloading'}
Oct 08 20:55:55.775318 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:55.874930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] creating snapshot='volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 20:55:56.543203 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] cloning 'volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21@volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f.clone_snap' to 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 20:55:56.716204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:55:56.717579 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:55:56.718219 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:55:56.757712 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 20:55:56.762858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a0385-58c1-4428-93da-d223194484b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'volume_size': 1, 'source_volid': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'source_volstatus': 'downloading'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:56.767840 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5296e467-a5c2-4eaa-90fd-1e24f17e3187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:56.781021 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f (75bc1a74-4c1d-4a8b-bacf-00463fd6604f): created successfully
Oct 08 20:55:56.787373 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5296e467-a5c2-4eaa-90fd-1e24f17e3187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:56.798252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (7263043b-21d6-4eb7-b26a-7b1bcba1d45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:56.811776 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Created volume successfully.
Oct 08 20:55:56.871897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Creating new image-volume cache entry for image c508bd7f-7db9-4b2c-af7c-be54a855c355 on ncdv-master-1@ceph#ceph {{(pid=133344) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Oct 08 20:55:56.881622 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] New image-volume cache entry created: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 55, 56, 876080)}. {{(pid=133344) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Oct 08 20:55:56.897634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 40.558s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:55:56.901085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Marking volume b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 20:55:56.933712 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 20:55:56.934447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Creating volume glance metadata for volume b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 20:55:57.106099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66c4807-4874-41f7-baf5-e1cfde36ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b575670>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:57.118387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebf2656-ebda-48cb-addd-134993651b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:57.156972 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 (b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21): created successfully
Oct 08 20:55:57.163805 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebf2656-ebda-48cb-addd-134993651b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:57.176008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (f5f721b0-c435-41af-bb57-91777f670f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:57.198333 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2fcefa60-1915-4c2f-afc2-2566da1a94eb tempest-TaggedBootDevicesTest_v242-1262294407 None] Created volume successfully.
Oct 08 20:55:59.123980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:55:59.158695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (12664dd1-1ecc-45cf-b471-931e5f57fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:59.166192 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a376ef-8c03-41b4-a771-054d5859923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.198738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a376ef-8c03-41b4-a771-054d5859923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-816409559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9750f5d-e3dd-4b3e-a92f-9e65fda40303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51fae793a147d88e5d956352f18b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:55:59Z,use_quota=True,user_id='bc0c5c9593754f1cb98f9689b29606a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.207987 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8f692-009c-48c4-abd4-ee7029cf8404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.216310 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e8f692-009c-48c4-abd4-ee7029cf8404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.226021 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88840ff4-1a86-440b-b229-6e01db504181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.231024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88840ff4-1a86-440b-b229-6e01db504181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'volume_name': 'volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.249138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7370983-219f-45f8-8ab8-6c1bfa63dc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.254550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7370983-219f-45f8-8ab8-6c1bfa63dc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.261111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e0b6ea-3857-4e9e-9665-953f257e5127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.263747 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume a9750f5d-e3dd-4b3e-a92f-9e65fda40303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'volume_size': 1}
Oct 08 20:55:59.264377 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] creating volume 'volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 20:55:59.265718 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:55:59.395315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:55:59.396646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:55:59.405393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e0b6ea-3857-4e9e-9665-953f257e5127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.412555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38f2ab3-4e43-43a3-9b01-f890670133db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.432955 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303 (a9750f5d-e3dd-4b3e-a92f-9e65fda40303): created successfully
Oct 08 20:55:59.439804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38f2ab3-4e43-43a3-9b01-f890670133db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.449995 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (12664dd1-1ecc-45cf-b471-931e5f57fcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:59.471686 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c7c9be50-d4d5-4430-86b6-880956ad3a47 tempest-TaggedBootDevicesTest_v242-1262294407 None] Created volume successfully.
Oct 08 20:55:59.757216 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:55:59.770860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Flow 'volume_create_manager' (ccf1e266-7762-4300-a2cd-c9726ac891b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:55:59.777297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed3a114-1441-4cdb-b14e-e9c5f4a3d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.800753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed3a114-1441-4cdb-b14e-e9c5f4a3d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-130294687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7646db34-383d-4fbe-a722-be3019ae4a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecc2dd2407b4819874bed09cb27959a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:56:00Z,use_quota=True,user_id='474ca64d1b1d4e30916b517645aba882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.811134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2069fe-e809-46cd-b1ff-07b3218c6054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.814371 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2069fe-e809-46cd-b1ff-07b3218c6054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.821721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c909f-a3cd-41e8-b181-3c57787bfd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.827869 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c909f-a3cd-41e8-b181-3c57787bfd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7646db34-383d-4fbe-a722-be3019ae4a2f', 'volume_name': 'volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.834993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5f32e-d4dc-4a46-a40c-79572e8896dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.846986 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5f32e-d4dc-4a46-a40c-79572e8896dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:55:59.852376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5c99d6-15a9-493c-b968-6abba8958107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:55:59.859530 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Volume 7646db34-383d-4fbe-a722-be3019ae4a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'volume_size': 1}
Oct 08 20:55:59.860165 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] creating volume 'volume-7646db34-383d-4fbe-a722-be3019ae4a2f' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 20:55:59.861046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:00.049297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:56:00.049871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:56:00.060092 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5c99d6-15a9-493c-b968-6abba8958107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:00.080722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fc672d-b570-4f1d-bc57-a2b0a88494b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:00.101548 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Volume volume-7646db34-383d-4fbe-a722-be3019ae4a2f (7646db34-383d-4fbe-a722-be3019ae4a2f): created successfully
Oct 08 20:56:00.137334 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fc672d-b570-4f1d-bc57-a2b0a88494b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:00.179954 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Flow 'volume_create_manager' (ccf1e266-7762-4300-a2cd-c9726ac891b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:00.212750 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e6668b83-772c-4840-ba4e-fb02857c9c4f tempest-LiveMigrationTest-739175934 None] Created volume successfully.
Oct 08 20:56:01.334210 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:56:01.370292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (4c46284b-5854-4d45-b99d-c50d37358120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:01.378462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d25f90-ffdf-4da7-b77a-67aac06c6183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.402447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d25f90-ffdf-4da7-b77a-67aac06c6183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1705798773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e89fe668-7e03-49ec-be17-8fa1cabeff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51fae793a147d88e5d956352f18b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:56:01Z,use_quota=True,user_id='bc0c5c9593754f1cb98f9689b29606a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.410117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f336ce-e016-44ac-8ed8-b5c7c81059d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.415658 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f336ce-e016-44ac-8ed8-b5c7c81059d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.423390 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1522b-fce8-49c0-9071-9bedb9873097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.428430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1522b-fce8-49c0-9071-9bedb9873097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'volume_name': 'volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.435355 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c2c38f-8ab0-410e-80a4-5afdd947753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.440352 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c2c38f-8ab0-410e-80a4-5afdd947753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.454403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a92037-b7a1-4618-ab58-a35d8d74516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.456426 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume e89fe668-7e03-49ec-be17-8fa1cabeff3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'volume_size': 1}
Oct 08 20:56:01.457172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] creating volume 'volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 20:56:01.458244 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:01.590314 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:56:01.591539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:56:01.596665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a92037-b7a1-4618-ab58-a35d8d74516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.607813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a62d1d8-62f8-4d2c-b125-f67071f51c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:01.631101 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c (e89fe668-7e03-49ec-be17-8fa1cabeff3c): created successfully
Oct 08 20:56:01.635954 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a62d1d8-62f8-4d2c-b125-f67071f51c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:01.659982 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Flow 'volume_create_manager' (4c46284b-5854-4d45-b99d-c50d37358120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:01.685976 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3f7058e3-432a-4411-8b04-7fb397e0babd tempest-TaggedBootDevicesTest_v242-1262294407 None] Created volume successfully.
Oct 08 20:56:02.515785 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-aa94a6d2-1749-419d-bc08-70d18778518c req-a8d4f1c0-ab1a-4d2b-a320-f7c841e542f5 tempest-LiveMigrationTest-739175934 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:04.092549 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-aa94a6d2-1749-419d-bc08-70d18778518c req-a8d4f1c0-ab1a-4d2b-a320-f7c841e542f5 tempest-LiveMigrationTest-739175934 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.578s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:04.094382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-aa94a6d2-1749-419d-bc08-70d18778518c req-a8d4f1c0-ab1a-4d2b-a320-f7c841e542f5 tempest-LiveMigrationTest-739175934 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '7646db34-383d-4fbe-a722-be3019ae4a2f', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:04.166530 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=72,cinder:UPDATE=11,cinder:INSERT=14,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:56:04.201693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-aa94a6d2-1749-419d-bc08-70d18778518c req-a8d4f1c0-ab1a-4d2b-a320-f7c841e542f5 tempest-LiveMigrationTest-739175934 None] Connection info returned from driver {'name': 'volumes/volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7646db34-383d-4fbe-a722-be3019ae4a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c3ff1e31-9a0d-469d-b372-f716d0aadc25'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:04.399469 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-aa94a6d2-1749-419d-bc08-70d18778518c req-a8d4f1c0-ab1a-4d2b-a320-f7c841e542f5 tempest-LiveMigrationTest-739175934 None] attachment_update completed successfully.
Oct 08 20:56:05.941179 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:56:05.943226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:06.041181 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:06.110777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:56:21.118611 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:56:24.378394 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-fbe02e96-73f7-4546-b56b-6b82cf26340a tempest-LiveMigrationTest-245808024 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:26.548708 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-fbe02e96-73f7-4546-b56b-6b82cf26340a tempest-LiveMigrationTest-245808024 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.175s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:26.550623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-fbe02e96-73f7-4546-b56b-6b82cf26340a tempest-LiveMigrationTest-245808024 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '7646db34-383d-4fbe-a722-be3019ae4a2f', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:26.597936 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=48,cinder:INSERT=10,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:56:26.611446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-fbe02e96-73f7-4546-b56b-6b82cf26340a tempest-LiveMigrationTest-245808024 None] Connection info returned from driver {'name': 'volumes/volume-7646db34-383d-4fbe-a722-be3019ae4a2f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7646db34-383d-4fbe-a722-be3019ae4a2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6c116b6-2c42-4b6d-94f4-51d474f253a9'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:26.756216 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-fbe02e96-73f7-4546-b56b-6b82cf26340a tempest-LiveMigrationTest-245808024 None] attachment_update completed successfully.
Oct 08 20:56:30.366108 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:56:30.427065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Flow 'volume_create_manager' (7eb5c2b5-d1d0-4750-b662-ac7685713d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:30.445540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa5be3b-0e49-4a74-9dbb-db5ba21f0134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.466193 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa5be3b-0e49-4a74-9dbb-db5ba21f0134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-725198823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0c11645-2e47-4de8-8a67-b49a20d9fe3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5c7906a4714a1887cb823e1c3a6056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:56:30Z,use_quota=True,user_id='d54b1c5c00544be4b60132d09817c8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.476116 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2f4f90-ae2e-469d-bf4d-5db5997cc54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.482740 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2f4f90-ae2e-469d-bf4d-5db5997cc54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.492922 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1123e-1f0f-4fef-8208-4c17b81f860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.498687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1123e-1f0f-4fef-8208-4c17b81f860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'volume_name': 'volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.521997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33007270-6e5e-4359-acd7-4a78281ca595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.534530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33007270-6e5e-4359-acd7-4a78281ca595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.564882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5192f874-20d1-465c-a885-0baa5753b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.570566 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume b0c11645-2e47-4de8-8a67-b49a20d9fe3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'volume_size': 1}
Oct 08 20:56:30.573292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] creating volume 'volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 20:56:30.575811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:30.785577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:56:30.785884 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:56:30.790230 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5192f874-20d1-465c-a885-0baa5753b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.802243 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb07cf9-bbb0-4fc9-b7df-335de3470df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:30.826155 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e (b0c11645-2e47-4de8-8a67-b49a20d9fe3e): created successfully
Oct 08 20:56:30.831267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb07cf9-bbb0-4fc9-b7df-335de3470df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:30.843726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Flow 'volume_create_manager' (7eb5c2b5-d1d0-4750-b662-ac7685713d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:30.872389 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-11f8cd36-3dc0-49cf-915d-3d6101ac7f5b tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Created volume successfully.
Oct 08 20:56:32.770168 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 req-d5afa471-6c60-4967-9b3f-cfc2bfa90d6e tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:34.371875 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 req-d5afa471-6c60-4967-9b3f-cfc2bfa90d6e tempest-LiveAutoBlockMigrationV225Test-2037918034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.601s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:34.373492 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 req-d5afa471-6c60-4967-9b3f-cfc2bfa90d6e tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:34.429490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 req-d5afa471-6c60-4967-9b3f-cfc2bfa90d6e tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Connection info returned from driver {'name': 'volumes/volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8d058a52-fa48-491a-bbb5-abb8bc385433'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:34.597420 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-cf219e7e-3f95-43dd-b15d-265bfe4492a8 req-d5afa471-6c60-4967-9b3f-cfc2bfa90d6e tempest-LiveAutoBlockMigrationV225Test-2037918034 None] attachment_update completed successfully.
Oct 08 20:56:37.076540 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-6700817e-924d-4c56-90c2-6871bbcb0a34 tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:38.202475 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-6700817e-924d-4c56-90c2-6871bbcb0a34 tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.125s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:38.203344 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-6700817e-924d-4c56-90c2-6871bbcb0a34 tempest-TaggedBootDevicesTest_v242-1262294407 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:38.237443 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-6700817e-924d-4c56-90c2-6871bbcb0a34 tempest-TaggedBootDevicesTest_v242-1262294407 None] Connection info returned from driver {'name': 'volumes/volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '39284fc6-8db8-4d52-a6e1-40617452baec'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:38.363528 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-6700817e-924d-4c56-90c2-6871bbcb0a34 tempest-TaggedBootDevicesTest_v242-1262294407 None] attachment_update completed successfully.
Oct 08 20:56:39.363071 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-b0274334-dca5-4fa3-be38-e997df479b95 tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:40.599982 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-8642c273-d152-4cfa-8b1e-4b8420421c10 tempest-LiveMigrationTest-245808024 None] Terminate volume connection completed successfully.
Oct 08 20:56:40.601701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-0d545a33-08df-438b-8e60-2b40df12f7c9 req-8642c273-d152-4cfa-8b1e-4b8420421c10 tempest-LiveMigrationTest-245808024 None] Deleting attachment c3ff1e31-9a0d-469d-b372-f716d0aadc25. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:56:40.685436 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-b0274334-dca5-4fa3-be38-e997df479b95 tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.322s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:40.686290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-b0274334-dca5-4fa3-be38-e997df479b95 tempest-TaggedBootDevicesTest_v242-1262294407 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:40.730732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-b0274334-dca5-4fa3-be38-e997df479b95 tempest-TaggedBootDevicesTest_v242-1262294407 None] Connection info returned from driver {'name': 'volumes/volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a9750f5d-e3dd-4b3e-a92f-9e65fda40303', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '25acc2e0-8a4f-4472-8efd-73907f65a5a2'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:40.856346 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-b0274334-dca5-4fa3-be38-e997df479b95 tempest-TaggedBootDevicesTest_v242-1262294407 None] attachment_update completed successfully.
Oct 08 20:56:41.392865 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-ad6e2899-bfd7-46cb-b773-329a802e9a96 tempest-TaggedBootDevicesTest_v242-1262294407 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:42.283077 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-ad6e2899-bfd7-46cb-b773-329a802e9a96 tempest-TaggedBootDevicesTest_v242-1262294407 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.890s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:42.284117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-ad6e2899-bfd7-46cb-b773-329a802e9a96 tempest-TaggedBootDevicesTest_v242-1262294407 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:42.347290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-ad6e2899-bfd7-46cb-b773-329a802e9a96 tempest-TaggedBootDevicesTest_v242-1262294407 None] Connection info returned from driver {'name': 'volumes/volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e89fe668-7e03-49ec-be17-8fa1cabeff3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '88689f83-a588-4178-995b-23808101b745'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:42.452021 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-48cacffe-38a1-4d59-9a9f-361e4b046d54 req-ad6e2899-bfd7-46cb-b773-329a802e9a96 tempest-TaggedBootDevicesTest_v242-1262294407 None] attachment_update completed successfully.
Oct 08 20:56:44.337367 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-574d5c67-4366-46cc-97cb-8caff10ad3aa tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:56:45.705089 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-574d5c67-4366-46cc-97cb-8caff10ad3aa tempest-LiveAutoBlockMigrationV225Test-1752855597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.368s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:56:45.706847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-574d5c67-4366-46cc-97cb-8caff10ad3aa tempest-LiveAutoBlockMigrationV225Test-1752855597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:56:45.751711 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-574d5c67-4366-46cc-97cb-8caff10ad3aa tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Connection info returned from driver {'name': 'volumes/volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b0c11645-2e47-4de8-8a67-b49a20d9fe3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '45bb09d1-f432-4208-af14-0a1fc5694945'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:56:45.865067 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-574d5c67-4366-46cc-97cb-8caff10ad3aa tempest-LiveAutoBlockMigrationV225Test-1752855597 None] attachment_update completed successfully.
Oct 08 20:56:54.159408 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=83,cinder:UPDATE=15 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:56:54.183378 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-12f9bd93-ede7-42c8-8e8a-208509369235 req-437e83b0-187d-47da-b547-7218bdf1d394 tempest-LiveMigrationTest-739175934 None] Terminate volume connection completed successfully.
Oct 08 20:56:54.183847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-12f9bd93-ede7-42c8-8e8a-208509369235 req-437e83b0-187d-47da-b547-7218bdf1d394 tempest-LiveMigrationTest-739175934 None] Deleting attachment d6c116b6-2c42-4b6d-94f4-51d474f253a9. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:56:56.197050 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:56:56.246177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Flow 'volume_create_manager' (290df075-2a8d-465d-b8d3-60027f8e8c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:56.257992 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202708b4-0b8e-44b9-98f1-dac692fbb9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:56.306856 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202708b4-0b8e-44b9-98f1-dac692fbb9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-691616471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8994233-8420-4f40-b8b2-5054eebfce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecc2dd2407b4819874bed09cb27959a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:56:56Z,use_quota=True,user_id='474ca64d1b1d4e30916b517645aba882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:56.313044 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c1d20-1b24-4e1c-a8f7-b64b5cbe5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:56.328783 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5c1d20-1b24-4e1c-a8f7-b64b5cbe5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:56.341063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8174dc4-1ae7-4e44-96f6-e84ac7ccdcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:56.522030 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8174dc4-1ae7-4e44-96f6-e84ac7ccdcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8994233-8420-4f40-b8b2-5054eebfce14', 'volume_name': 'volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a311d90>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:56.534845 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829993b-2d85-4f1a-9bb0-4d9f4b5f4d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:56.559260 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829993b-2d85-4f1a-9bb0-4d9f4b5f4d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:56.566692 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268208b2-dc54-45df-9080-e195e6744671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:56.570466 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Volume a8994233-8420-4f40-b8b2-5054eebfce14: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a311d90>}
Oct 08 20:56:56.573993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Cloning a8994233-8420-4f40-b8b2-5054eebfce14 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 20:56:56.575002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:56:56.588499 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:56:56.615973 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 56, 56, 599105)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:56:56.617095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:56:56.619008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 20:56:56.625008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:56:56.628197 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 20:56:56.643963 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 56, 56, 639315)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:56:56.644747 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:56:56.645442 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 20:56:56.688584 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:56:56.815135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] creating snapshot='volume-a8994233-8420-4f40-b8b2-5054eebfce14.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 20:56:57.769674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-a8994233-8420-4f40-b8b2-5054eebfce14.clone_snap' to 'volume-a8994233-8420-4f40-b8b2-5054eebfce14' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 20:56:57.961499 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:56:57.963377 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:56:57.963896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:56:58.001544 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 20:56:58.002322 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Marking volume a8994233-8420-4f40-b8b2-5054eebfce14 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 20:56:58.013780 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to a8994233-8420-4f40-b8b2-5054eebfce14. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 20:56:58.014232 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Creating volume glance metadata for volume a8994233-8420-4f40-b8b2-5054eebfce14 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 20:56:58.017072 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=76,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:56:58.147150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268208b2-dc54-45df-9080-e195e6744671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a311d90>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:58.152875 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7202290-2a60-4a2c-bb44-5deb47e0b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:56:58.178160 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Volume volume-a8994233-8420-4f40-b8b2-5054eebfce14 (a8994233-8420-4f40-b8b2-5054eebfce14): created successfully
Oct 08 20:56:58.184088 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7202290-2a60-4a2c-bb44-5deb47e0b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:56:58.190329 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Flow 'volume_create_manager' (290df075-2a8d-465d-b8d3-60027f8e8c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:56:58.201291 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e7ce6935-0fcd-4380-9479-249ef2e969bd tempest-LiveMigrationTest-739175934 None] Created volume successfully.
Oct 08 20:56:58.257742 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-63b12d8f-1124-42b2-a393-8356f285979b tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Terminate volume connection completed successfully.
Oct 08 20:56:58.259156 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d362ca16-4f3f-4ff2-80be-11295ea93923 req-63b12d8f-1124-42b2-a393-8356f285979b tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Deleting attachment 8d058a52-fa48-491a-bbb5-abb8bc385433. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:57:03.026242 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-a1f82c0f-49ef-4085-acef-40596d40e832 req-7c75ead4-c38a-4f28-b1c3-968570de5f66 tempest-LiveMigrationTest-739175934 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:57:03.969231 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-a1f82c0f-49ef-4085-acef-40596d40e832 req-7c75ead4-c38a-4f28-b1c3-968570de5f66 tempest-LiveMigrationTest-739175934 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.939s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:57:03.970346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a1f82c0f-49ef-4085-acef-40596d40e832 req-7c75ead4-c38a-4f28-b1c3-968570de5f66 tempest-LiveMigrationTest-739175934 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'a8994233-8420-4f40-b8b2-5054eebfce14', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:57:04.052060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a1f82c0f-49ef-4085-acef-40596d40e832 req-7c75ead4-c38a-4f28-b1c3-968570de5f66 tempest-LiveMigrationTest-739175934 None] Connection info returned from driver {'name': 'volumes/volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8994233-8420-4f40-b8b2-5054eebfce14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4ba1f1e7-dc87-46f7-ae9c-6f980b92dd9a'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:57:04.150167 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-a1f82c0f-49ef-4085-acef-40596d40e832 req-7c75ead4-c38a-4f28-b1c3-968570de5f66 tempest-LiveMigrationTest-739175934 None] attachment_update completed successfully.
Oct 08 20:57:05.938411 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:57:05.939565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:06.024879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:06.125861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:57:08.578933 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a req-ee4899fb-894f-49bc-b22c-364ab57175e9 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Terminate volume connection completed successfully.
Oct 08 20:57:08.579582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f522afc5-a7fc-42a5-b94e-2cc1b571b82a req-ee4899fb-894f-49bc-b22c-364ab57175e9 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Deleting attachment 45bb09d1-f432-4208-af14-0a1fc5694945. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:57:10.657808 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:57:10.687696 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Flow 'volume_create_manager' (b2aa016d-413a-4e42-ba50-6b3525d30783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:57:10.703583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b966b28-7793-4fa2-b44a-7bdb6fb11f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:10.762461 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b966b28-7793-4fa2-b44a-7bdb6fb11f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1445609649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d78a1072-8e08-4aab-83e0-93be77a2a9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5c7906a4714a1887cb823e1c3a6056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:57:11Z,use_quota=True,user_id='d54b1c5c00544be4b60132d09817c8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:10.769769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ff6b36-c11f-4538-b974-c6448afc7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:10.775991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ff6b36-c11f-4538-b974-c6448afc7547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:10.793580 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc1cb8c-c50a-4038-8be3-d7117b2bad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:10.934695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc1cb8c-c50a-4038-8be3-d7117b2bad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd78a1072-8e08-4aab-83e0-93be77a2a9bb', 'volume_name': 'volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a290430>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:10.942287 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd80a3da-4d74-4a9a-9be5-8155c929315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:10.948639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd80a3da-4d74-4a9a-9be5-8155c929315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:10.954611 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3f0ca8-70a6-4f89-b61c-9e0902bd08de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:10.956749 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume d78a1072-8e08-4aab-83e0-93be77a2a9bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a290430>}
Oct 08 20:57:10.958370 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Cloning d78a1072-8e08-4aab-83e0-93be77a2a9bb from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 20:57:10.959295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:57:10.971998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:57:10.984767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 57, 10, 977956)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:57:10.985997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:57:10.986637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 20:57:10.991859 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:57:10.993531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 20:57:11.000120 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 57, 10, 997595)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:57:11.000812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:57:11.001542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 20:57:11.015500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:11.092761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] creating snapshot='volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 20:57:12.043615 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb.clone_snap' to 'volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 20:57:12.301781 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:57:12.306155 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:57:12.306638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:57:12.382729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 20:57:12.383643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Marking volume d78a1072-8e08-4aab-83e0-93be77a2a9bb as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 20:57:12.399989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to d78a1072-8e08-4aab-83e0-93be77a2a9bb. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 20:57:12.400844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Creating volume glance metadata for volume d78a1072-8e08-4aab-83e0-93be77a2a9bb backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 20:57:12.534889 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3f0ca8-70a6-4f89-b61c-9e0902bd08de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a290430>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:12.562032 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8095d1-e60f-4820-a907-ce9cb8ac599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:57:12.594856 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb (d78a1072-8e08-4aab-83e0-93be77a2a9bb): created successfully
Oct 08 20:57:12.602602 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8095d1-e60f-4820-a907-ce9cb8ac599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:57:12.631476 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Flow 'volume_create_manager' (b2aa016d-413a-4e42-ba50-6b3525d30783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:57:12.650173 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-01a233ef-f9c5-4061-83e3-a739f0d664c6 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Created volume successfully.
Oct 08 20:57:18.425799 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 req-84010f89-4b6a-4bc3-945a-1dd631c37c90 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:57:19.846569 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 req-84010f89-4b6a-4bc3-945a-1dd631c37c90 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.425s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:57:19.847418 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 req-84010f89-4b6a-4bc3-945a-1dd631c37c90 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd78a1072-8e08-4aab-83e0-93be77a2a9bb', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:57:19.885585 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 req-84010f89-4b6a-4bc3-945a-1dd631c37c90 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Connection info returned from driver {'name': 'volumes/volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd78a1072-8e08-4aab-83e0-93be77a2a9bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cf6af44a-d67a-4965-b208-b4bbbaf23e18'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:57:20.024390 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d6fdc9c9-3f64-4b1a-a937-bc7a8459c0e4 req-84010f89-4b6a-4bc3-945a-1dd631c37c90 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] attachment_update completed successfully.
Oct 08 20:57:32.050063 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=52,cinder:INSERT=10,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:57:32.051396 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=6,cinder:INSERT=14,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:57:32.783912 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-22526f9a-8c7b-4d60-ac00-dd4462f27063 tempest-LiveMigrationTest-245808024 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:57:34.122777 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-22526f9a-8c7b-4d60-ac00-dd4462f27063 tempest-LiveMigrationTest-245808024 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.339s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:57:34.130381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-22526f9a-8c7b-4d60-ac00-dd4462f27063 tempest-LiveMigrationTest-245808024 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'a8994233-8420-4f40-b8b2-5054eebfce14', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:57:34.190079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-22526f9a-8c7b-4d60-ac00-dd4462f27063 tempest-LiveMigrationTest-245808024 None] Connection info returned from driver {'name': 'volumes/volume-a8994233-8420-4f40-b8b2-5054eebfce14', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8994233-8420-4f40-b8b2-5054eebfce14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2dffc100-1d14-4692-a62d-e84dc3e2b589'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:57:34.322900 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-22526f9a-8c7b-4d60-ac00-dd4462f27063 tempest-LiveMigrationTest-245808024 None] attachment_update completed successfully.
Oct 08 20:57:35.713886 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-280769be-c7ad-406e-9183-a03ca3b188df tempest-LiveMigrationTest-245808024 None] Terminate volume connection completed successfully.
Oct 08 20:57:35.715316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-22236678-434b-45bb-acf2-5f0fa3b3e593 req-280769be-c7ad-406e-9183-a03ca3b188df tempest-LiveMigrationTest-245808024 None] Deleting attachment 2dffc100-1d14-4692-a62d-e84dc3e2b589. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:57:45.714154 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:57:46.410949 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-626bf760-2630-4b1f-a9aa-40d1edcd7c9a tempest-LiveMigrationTest-739175934 None] Terminate volume connection completed successfully.
Oct 08 20:57:46.411796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-626bf760-2630-4b1f-a9aa-40d1edcd7c9a tempest-LiveMigrationTest-739175934 None] Deleting attachment 4ba1f1e7-dc87-46f7-ae9c-6f980b92dd9a. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:57:46.624386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Acquiring lock "cinder-a8994233-8420-4f40-b8b2-5054eebfce14-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:57:46.637032 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Lock "cinder-a8994233-8420-4f40-b8b2-5054eebfce14-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:57:46.696636 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:46.817178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 20:57:46.825349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] deleting rbd volume volume-a8994233-8420-4f40-b8b2-5054eebfce14 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 20:57:47.267528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 20:57:47.308964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] deleting parent snapshot volume-a8994233-8420-4f40-b8b2-5054eebfce14.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 20:57:47.861847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Created reservations ['79261712-6e8b-423a-9eea-749f68cb3079', 'c3dc85ae-a007-4a23-8254-3ea87f7c4059', 'bb67d042-56fe-4c16-92d8-753b0b7ec108', '2fcee570-19c6-4421-9db1-b2b0b51ed3b0'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 20:57:48.056225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:48.139691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:48.208475 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:57:48.224934 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Deleted volume successfully.
Oct 08 20:57:48.240533 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-91e54ea6-fc1f-4936-8a45-516c01122475 req-8575e2fb-6b7a-4512-b889-e1dc47c3ef7f tempest-LiveMigrationTest-739175934 None] Lock "cinder-a8994233-8420-4f40-b8b2-5054eebfce14-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:57:51.534613 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Acquiring lock "cinder-7646db34-383d-4fbe-a722-be3019ae4a2f-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:57:51.588388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Lock "cinder-7646db34-383d-4fbe-a722-be3019ae4a2f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:57:51.658918 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:51.721624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 20:57:51.722930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Volume volume-7646db34-383d-4fbe-a722-be3019ae4a2f is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:57:51.742835 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] deleting rbd volume volume-7646db34-383d-4fbe-a722-be3019ae4a2f {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 20:57:52.159227 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Created reservations ['b810f07e-0650-4ae7-83bb-734e6ac1f808', '2fc6cbca-9a65-4e9f-bfe3-e8f10acc955f', '402ac282-3f4b-4710-9946-d1adda264f41', '1188c73c-f2ef-4635-9d0d-41bcfef50c7d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 20:57:52.222791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:52.293173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:57:52.352935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:57:52.358172 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Deleted volume successfully.
Oct 08 20:57:52.382871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b17311c5-6e00-4d6f-aedf-d99d24231878 tempest-LiveMigrationTest-739175934 None] Lock "cinder-7646db34-383d-4fbe-a722-be3019ae4a2f-delete_volume" released by "delete_volume" :: held 0.794s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:57:53.879059 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-b89a4ffd-92ed-4b8f-a4fd-11b001ec5812 tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:57:54.818969 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-b89a4ffd-92ed-4b8f-a4fd-11b001ec5812 tempest-LiveAutoBlockMigrationV225Test-1752855597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.940s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:57:54.819815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-b89a4ffd-92ed-4b8f-a4fd-11b001ec5812 tempest-LiveAutoBlockMigrationV225Test-1752855597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd78a1072-8e08-4aab-83e0-93be77a2a9bb', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:57:54.853725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-b89a4ffd-92ed-4b8f-a4fd-11b001ec5812 tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Connection info returned from driver {'name': 'volumes/volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd78a1072-8e08-4aab-83e0-93be77a2a9bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3acbf03f-ff64-4f6c-9b68-11e370e28529'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:57:54.914815 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-b89a4ffd-92ed-4b8f-a4fd-11b001ec5812 tempest-LiveAutoBlockMigrationV225Test-1752855597 None] attachment_update completed successfully.
Oct 08 20:58:03.018805 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=51,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:58:03.022028 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-a9c4981b-e07f-496b-95b1-04d8730aca7b tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Terminate volume connection completed successfully.
Oct 08 20:58:03.022451 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-2dc23d17-9344-4195-8ea3-8f9a7ce96e16 req-a9c4981b-e07f-496b-95b1-04d8730aca7b tempest-LiveAutoBlockMigrationV225Test-1752855597 None] Deleting attachment cf6af44a-d67a-4965-b208-b4bbbaf23e18. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:58:05.946083 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:58:05.947560 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:06.014743 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:06.088251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:58:13.061283 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-517b65f4-2e60-49f6-babf-6d84a2d9dcde tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Terminate volume connection completed successfully.
Oct 08 20:58:13.063043 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-517b65f4-2e60-49f6-babf-6d84a2d9dcde tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Deleting attachment 3acbf03f-ff64-4f6c-9b68-11e370e28529. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 20:58:13.316936 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Acquiring lock "cinder-d78a1072-8e08-4aab-83e0-93be77a2a9bb-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:58:13.351961 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-d78a1072-8e08-4aab-83e0-93be77a2a9bb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:58:13.432866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:13.556500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 20:58:13.570136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] deleting rbd volume volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 20:58:13.996415 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 20:58:14.036753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] deleting parent snapshot volume-d78a1072-8e08-4aab-83e0-93be77a2a9bb.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 20:58:14.746686 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Acquiring lock "cinder-b0c11645-2e47-4de8-8a67-b49a20d9fe3e-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:58:14.798330 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-b0c11645-2e47-4de8-8a67-b49a20d9fe3e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:58:14.890529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Created reservations ['56330002-8495-4609-9b58-1817d5a3d6ea', '2945ed1d-5240-4ebf-ac3c-91ee141bcc85', 'd5009923-97ae-4d12-9c3f-363726f831ce', '795b4dd4-5d33-41a9-a84c-310691260f3b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 20:58:14.967799 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=70,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:58:14.979102 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:15.039013 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:15.125766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:58:15.133944 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:15.230898 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 20:58:15.231358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Volume volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:58:15.247209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] deleting rbd volume volume-b0c11645-2e47-4de8-8a67-b49a20d9fe3e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 20:58:15.251718 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Deleted volume successfully.
Oct 08 20:58:15.275227 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-924e014a-79d8-4ec4-b9ac-d7a6c48ec3db req-4db1ff94-96ca-4607-9fc7-f12255e23ce4 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-d78a1072-8e08-4aab-83e0-93be77a2a9bb-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:58:15.803294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Created reservations ['8b361ffd-dc3a-4873-b1f9-31ba815a3555', '12f07fc7-9ff9-4597-b409-aab14255c1e4', 'e24f40d3-10cf-478f-a729-7b8cb6e58d3c', 'bc9cb8ac-f255-4ffa-bf23-d8ccfac58ced'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 20:58:15.908862 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:15.979398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:16.072880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:58:16.093726 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Deleted volume successfully.
Oct 08 20:58:16.117850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2a242394-b8ec-40b8-a32a-0f1acb4d60f7 tempest-LiveAutoBlockMigrationV225Test-2037918034 None] Lock "cinder-b0c11645-2e47-4de8-8a67-b49a20d9fe3e-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:58:32.058541 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:58:37.835749 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=35,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:58:37.864315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 20:58:37.888668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Flow 'volume_create_manager' (0a40458f-71ca-414a-9809-3cf98d7f8a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:58:37.896006 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce9c0f-a4e1-4398-a6e7-8c9cf95ae11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:37.930923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce9c0f-a4e1-4398-a6e7-8c9cf95ae11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T20:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1149513918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f364ca50-5843-462f-9ca6-f2739fdb87ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82999f8bc36455bafd8eed23c68e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T20:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T20:58:38Z,use_quota=True,user_id='3d96135705514061bef9306753143357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:37.945408 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0875e829-7a86-46a7-a2f9-c3856944a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:37.950943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0875e829-7a86-46a7-a2f9-c3856944a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:37.959074 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a723ab-6be0-43ec-b80f-8996143cc7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:38.073284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a723ab-6be0-43ec-b80f-8996143cc7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f364ca50-5843-462f-9ca6-f2739fdb87ea', 'volume_name': 'volume-f364ca50-5843-462f-9ca6-f2739fdb87ea', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b35d250>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:38.082555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f8eed8-4954-4f57-beb0-8f7408a38242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:38.087340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f8eed8-4954-4f57-beb0-8f7408a38242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:38.095853 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6fe236-6a23-4f1b-bf27-bbf3ed975d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:38.098279 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Volume f364ca50-5843-462f-9ca6-f2739fdb87ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f364ca50-5843-462f-9ca6-f2739fdb87ea', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b35d250>}
Oct 08 20:58:38.099001 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Cloning f364ca50-5843-462f-9ca6-f2739fdb87ea from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 20:58:38.099903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 20:58:38.113348 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 20:58:38.129726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 58, 38, 119472)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:58:38.130380 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:58:38.130875 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 20:58:38.136177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 20:58:38.137500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 20:58:38.148138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 20, 58, 38, 141301)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 20:58:38.149064 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 20:58:38.149847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 20:58:38.167309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:58:38.272264 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] creating snapshot='volume-f364ca50-5843-462f-9ca6-f2739fdb87ea.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 20:58:38.609860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-f364ca50-5843-462f-9ca6-f2739fdb87ea.clone_snap' to 'volume-f364ca50-5843-462f-9ca6-f2739fdb87ea' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 20:58:38.854295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 20:58:38.855392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 20:58:38.855814 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 20:58:38.891227 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 20:58:38.892728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Marking volume f364ca50-5843-462f-9ca6-f2739fdb87ea as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 20:58:38.910804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to f364ca50-5843-462f-9ca6-f2739fdb87ea. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 20:58:38.911487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Creating volume glance metadata for volume f364ca50-5843-462f-9ca6-f2739fdb87ea backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 20:58:39.026186 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6fe236-6a23-4f1b-bf27-bbf3ed975d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f364ca50-5843-462f-9ca6-f2739fdb87ea', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b35d250>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:39.033165 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5997b31-16fb-47f6-ba72-a141ab9b79bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 20:58:39.047886 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Volume volume-f364ca50-5843-462f-9ca6-f2739fdb87ea (f364ca50-5843-462f-9ca6-f2739fdb87ea): created successfully
Oct 08 20:58:39.063812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5997b31-16fb-47f6-ba72-a141ab9b79bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 20:58:39.080818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Flow 'volume_create_manager' (0a40458f-71ca-414a-9809-3cf98d7f8a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 20:58:39.105989 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5fff6641-0842-4cac-ba78-aa881646da3e tempest-ServersTestBootFromVolume-2114207729 None] Created volume successfully.
Oct 08 20:58:44.726654 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-aea7e2ba-4448-4f5c-b1f8-4957af987453 req-e6108d82-9114-4573-8292-0420d1f27214 tempest-ServersTestBootFromVolume-2114207729 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 20:58:46.383304 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-aea7e2ba-4448-4f5c-b1f8-4957af987453 req-e6108d82-9114-4573-8292-0420d1f27214 tempest-ServersTestBootFromVolume-2114207729 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.655s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 20:58:46.386500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-aea7e2ba-4448-4f5c-b1f8-4957af987453 req-e6108d82-9114-4573-8292-0420d1f27214 tempest-ServersTestBootFromVolume-2114207729 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f364ca50-5843-462f-9ca6-f2739fdb87ea', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'f364ca50-5843-462f-9ca6-f2739fdb87ea', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 20:58:46.452854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-aea7e2ba-4448-4f5c-b1f8-4957af987453 req-e6108d82-9114-4573-8292-0420d1f27214 tempest-ServersTestBootFromVolume-2114207729 None] Connection info returned from driver {'name': 'volumes/volume-f364ca50-5843-462f-9ca6-f2739fdb87ea', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f364ca50-5843-462f-9ca6-f2739fdb87ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '37d574b2-161b-49e4-a02b-61077a1790b0'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 20:58:46.678809 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-aea7e2ba-4448-4f5c-b1f8-4957af987453 req-e6108d82-9114-4573-8292-0420d1f27214 tempest-ServersTestBootFromVolume-2114207729 None] attachment_update completed successfully.
Oct 08 20:58:56.678923 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=29,cinder:UPDATE=3,cinder:INSERT=11 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:59:05.944555 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 20:59:05.946200 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:59:06.023714 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 20:59:06.101445 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 20:59:12.058459 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=29,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:59:22.067357 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 20:59:52.054686 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:02.056791 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:05.944244 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:00:05.944920 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:06.055284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:06.156469 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:00:22.073013 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:23.082016 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:23.095810 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-8d1c0d29-8e60-46c1-96dd-9f21d138ac91 tempest-ServersTestBootFromVolume-2114207729 None] Terminate volume connection completed successfully.
Oct 08 21:00:23.096813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-8d1c0d29-8e60-46c1-96dd-9f21d138ac91 tempest-ServersTestBootFromVolume-2114207729 None] Deleting attachment 37d574b2-161b-49e4-a02b-61077a1790b0. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:00:23.296759 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Acquiring lock "cinder-f364ca50-5843-462f-9ca6-f2739fdb87ea-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:00:23.313684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Lock "cinder-f364ca50-5843-462f-9ca6-f2739fdb87ea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:00:23.401054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:23.520915 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:00:23.531834 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] deleting rbd volume volume-f364ca50-5843-462f-9ca6-f2739fdb87ea {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:00:24.065436 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:00:24.115365 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] deleting parent snapshot volume-f364ca50-5843-462f-9ca6-f2739fdb87ea.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:00:25.382506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Created reservations ['40a7f29c-3da8-4a55-bdaa-741166c01c57', 'f2167549-6ce7-4d73-a64a-da3042f9a8f5', '2f595428-e60a-481f-80a2-6fdc617c9215', '72c7a103-6af2-47b1-97dc-8e32408374e5'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:00:25.460537 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:25.557292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:25.657966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:00:25.663433 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Deleted volume successfully.
Oct 08 21:00:25.680797 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-2dd1a620-5c0e-4d97-bc31-f43a3de4de9e req-eec4dbed-baab-4835-b595-35288492e4b8 tempest-ServersTestBootFromVolume-2114207729 None] Lock "cinder-f364ca50-5843-462f-9ca6-f2739fdb87ea-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:00:42.080526 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:42.367196 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:00:42.415124 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Flow 'volume_create_manager' (160a94be-24bf-4872-ab7d-0a11aeb5da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:00:42.429668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb43005-d5e5-4bdc-93a2-dbaf74b965bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.530646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb43005-d5e5-4bdc-93a2-dbaf74b965bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-775093284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8867601a-3418-4e8c-baf2-da1a50e3ef73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b00ee5e7828469f95bd90548d35982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:00:42Z,use_quota=True,user_id='1698dee4a2bf4ea19a6ee0c3d5cb5c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.538625 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b36cf8-d210-47cb-b312-ad71431dd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.557834 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b36cf8-d210-47cb-b312-ad71431dd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.576359 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab635670-bee1-4875-80ee-27978fd2f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.586869 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab635670-bee1-4875-80ee-27978fd2f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8867601a-3418-4e8c-baf2-da1a50e3ef73', 'volume_name': 'volume-8867601a-3418-4e8c-baf2-da1a50e3ef73', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.597811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5fd6f7-e1c2-419d-ba52-d6bb65855243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.609581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5fd6f7-e1c2-419d-ba52-d6bb65855243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.619657 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3bae16-b43f-4ec2-aa8d-63fe397a659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.646852 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume 8867601a-3418-4e8c-baf2-da1a50e3ef73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8867601a-3418-4e8c-baf2-da1a50e3ef73', 'volume_size': 1}
Oct 08 21:00:42.647614 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] creating volume 'volume-8867601a-3418-4e8c-baf2-da1a50e3ef73' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:00:42.651805 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:42.826458 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:00:42.827189 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:00:42.831332 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3bae16-b43f-4ec2-aa8d-63fe397a659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8867601a-3418-4e8c-baf2-da1a50e3ef73', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.842860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e09a-a03e-490f-84e5-96e46039536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:42.863203 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume volume-8867601a-3418-4e8c-baf2-da1a50e3ef73 (8867601a-3418-4e8c-baf2-da1a50e3ef73): created successfully
Oct 08 21:00:42.869789 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e09a-a03e-490f-84e5-96e46039536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:42.881423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Flow 'volume_create_manager' (160a94be-24bf-4872-ab7d-0a11aeb5da31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:00:42.905850 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-202bf76a-36bf-4ea4-8d92-b62980a92910 tempest-ServerRescueNegativeTestJSON-1823882791 None] Created volume successfully.
Oct 08 21:00:50.518971 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:00:50.555529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Flow 'volume_create_manager' (886f2826-e362-4376-94af-8d48dee31f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:00:50.561926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928842f8-1e4e-4bd2-80f0-af0efab71ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.578701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928842f8-1e4e-4bd2-80f0-af0efab71ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1388293782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7bdc4b7b-49a2-45d3-acde-2c3909fd91f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e191d6217f024a17a14184071ac674c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:00:50Z,use_quota=True,user_id='3d2ddfa343e748c089129b0039a12ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.583857 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7326d590-dcdb-4fb5-8a5e-1c800c88be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.588049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7326d590-dcdb-4fb5-8a5e-1c800c88be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.593635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b4c794-a47b-4d54-a1d8-4791c947c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.597695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b4c794-a47b-4d54-a1d8-4791c947c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'volume_name': 'volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.602577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9d54ba-29ee-4a12-9423-0eac00e96087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.607292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9d54ba-29ee-4a12-9423-0eac00e96087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.621479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a312ed87-2e00-4aca-b934-a2633d961fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.621479 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Volume 7bdc4b7b-49a2-45d3-acde-2c3909fd91f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'volume_size': 1}
Oct 08 21:00:50.621479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] creating volume 'volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:00:50.621479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:00:50.688464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:00:50.688998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:00:50.693397 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a312ed87-2e00-4aca-b934-a2633d961fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.699086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c2787a-a87a-4051-b4c3-afd503502eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:00:50.718614 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Volume volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 (7bdc4b7b-49a2-45d3-acde-2c3909fd91f7): created successfully
Oct 08 21:00:50.722570 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c2787a-a87a-4051-b4c3-afd503502eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:00:50.728371 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Flow 'volume_create_manager' (886f2826-e362-4376-94af-8d48dee31f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:00:50.742955 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-23411260-e162-40fe-8e42-18ca86e37265 tempest-VolumesAdminNegativeTest-557516914 None] Created volume successfully.
Oct 08 21:00:52.277596 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-e31a2200-7943-42da-b12c-f1f83c473cb9 req-204dfce2-525e-4d22-8b81-f04bc3b62fb9 tempest-VolumesAdminNegativeTest-557516914 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:00:54.088848 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-e31a2200-7943-42da-b12c-f1f83c473cb9 req-204dfce2-525e-4d22-8b81-f04bc3b62fb9 tempest-VolumesAdminNegativeTest-557516914 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.811s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:00:54.090285 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-e31a2200-7943-42da-b12c-f1f83c473cb9 req-204dfce2-525e-4d22-8b81-f04bc3b62fb9 tempest-VolumesAdminNegativeTest-557516914 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:00:54.095485 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=30,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:00:54.193010 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-e31a2200-7943-42da-b12c-f1f83c473cb9 req-204dfce2-525e-4d22-8b81-f04bc3b62fb9 tempest-VolumesAdminNegativeTest-557516914 None] Connection info returned from driver {'name': 'volumes/volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7bdc4b7b-49a2-45d3-acde-2c3909fd91f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cbdbd077-964c-4445-9afd-9a1493b9721f'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:00:54.332022 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-e31a2200-7943-42da-b12c-f1f83c473cb9 req-204dfce2-525e-4d22-8b81-f04bc3b62fb9 tempest-VolumesAdminNegativeTest-557516914 None] attachment_update completed successfully.
Oct 08 21:01:00.331672 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 req-6f5acce3-0642-4bc5-9280-22ea66d96f89 tempest-VolumesAdminNegativeTest-557516914 None] Terminate volume connection completed successfully.
Oct 08 21:01:00.332967 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-ddd06415-8a5a-4791-9fa0-e4da228dbb44 req-6f5acce3-0642-4bc5-9280-22ea66d96f89 tempest-VolumesAdminNegativeTest-557516914 None] Deleting attachment cbdbd077-964c-4445-9afd-9a1493b9721f. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:01:05.941305 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:01:05.942832 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:06.008594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:06.103443 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:01:09.471499 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:01:09.505049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Flow 'volume_create_manager' (fb677db9-3d12-4d5b-934d-b967bd03e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:01:09.512446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ee0ef-3feb-4c7b-b7fe-a966493b59ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.529744 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ee0ef-3feb-4c7b-b7fe-a966493b59ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-996901113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d9000e4-0140-4d89-9d9e-4730705b15bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b00ee5e7828469f95bd90548d35982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:01:09Z,use_quota=True,user_id='1698dee4a2bf4ea19a6ee0c3d5cb5c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.534827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed11e70-c36a-4901-a890-bb7575ae645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.538886 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed11e70-c36a-4901-a890-bb7575ae645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.544582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76918c25-361b-4f94-83cb-7179c9a15cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.548673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76918c25-361b-4f94-83cb-7179c9a15cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9000e4-0140-4d89-9d9e-4730705b15bf', 'volume_name': 'volume-3d9000e4-0140-4d89-9d9e-4730705b15bf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.553453 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b697f7-faae-40a1-89b0-01ed319925ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.557494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b697f7-faae-40a1-89b0-01ed319925ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.564106 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaef44a-a4ae-468d-b0b5-8660466d0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.565284 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume 3d9000e4-0140-4d89-9d9e-4730705b15bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9000e4-0140-4d89-9d9e-4730705b15bf', 'volume_size': 1}
Oct 08 21:01:09.565708 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] creating volume 'volume-3d9000e4-0140-4d89-9d9e-4730705b15bf' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:01:09.566379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:09.636660 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:01:09.637075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:01:09.647797 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaef44a-a4ae-468d-b0b5-8660466d0636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9000e4-0140-4d89-9d9e-4730705b15bf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.653042 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef44748-3a5c-4daa-9ec9-e7230e9e9548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:09.663461 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume volume-3d9000e4-0140-4d89-9d9e-4730705b15bf (3d9000e4-0140-4d89-9d9e-4730705b15bf): created successfully
Oct 08 21:01:09.672665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef44748-3a5c-4daa-9ec9-e7230e9e9548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:09.678419 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Flow 'volume_create_manager' (fb677db9-3d12-4d5b-934d-b967bd03e758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:01:09.688839 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a2a8fdbd-b126-4131-8e2b-da36e750bbfe tempest-ServerRescueNegativeTestJSON-1823882791 None] Created volume successfully.
Oct 08 21:01:18.262750 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=32,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:01:18.285093 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:01:18.315382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Flow 'volume_create_manager' (21a50884-768e-4019-9e6a-78f5229387fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:01:18.321970 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438e73d-3b64-4cf0-9ee3-76253f5c538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.343626 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438e73d-3b64-4cf0-9ee3-76253f5c538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1222104972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e191d6217f024a17a14184071ac674c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:01:18Z,use_quota=True,user_id='3d2ddfa343e748c089129b0039a12ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.350286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933ff485-91de-4cd6-af40-41b9b3d34ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.356725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933ff485-91de-4cd6-af40-41b9b3d34ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.366074 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb90c8a-70ca-4f58-892c-4520787f95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.371209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb90c8a-70ca-4f58-892c-4520787f95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c', 'volume_name': 'volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.381292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdce3bc-9c02-4e7b-8961-f4fd7f7ba1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.395139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdce3bc-9c02-4e7b-8961-f4fd7f7ba1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.414522 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2e8abe-de3a-4b77-a850-ef44979dfbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.416933 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Volume c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c', 'volume_size': 1}
Oct 08 21:01:18.417539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] creating volume 'volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:01:18.418346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:18.551989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:01:18.552640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:01:18.557742 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2e8abe-de3a-4b77-a850-ef44979dfbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.570532 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed69ce6-796e-407c-8455-6e6ff5da8af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:01:18.590846 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Volume volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c (c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c): created successfully
Oct 08 21:01:18.596674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed69ce6-796e-407c-8455-6e6ff5da8af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:01:18.628566 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Flow 'volume_create_manager' (21a50884-768e-4019-9e6a-78f5229387fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:01:18.649037 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b133aedc-43ed-48b8-8cf1-6a4f0af49f75 tempest-VolumesAdminNegativeTest-557516914 None] Created volume successfully.
Oct 08 21:01:19.405240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Acquiring lock "cinder-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:01:19.439024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Lock "cinder-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:01:19.514351 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:19.577076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:01:19.577559 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Volume volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:01:19.586652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] deleting rbd volume volume-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:01:20.051761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Created reservations ['4b2e1ba2-ce18-4066-a784-87213253bf81', '131c17e3-0247-49df-b8cb-edab42544969', 'e4fca230-3648-498a-978c-151503a2ffc7', '1fa87030-16f0-4e69-a50f-5d822f88742e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:01:20.148532 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:20.237143 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:20.308802 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:01:20.314517 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Deleted volume successfully.
Oct 08 21:01:20.330697 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8b9d4234-37c9-47b1-9f04-f874a6722feb tempest-VolumesAdminNegativeTest-557516914 None] Lock "cinder-c8bffdb4-b1dc-45a7-b95f-5219d71fdc6c-delete_volume" released by "delete_volume" :: held 0.891s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:01:25.817316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Acquiring lock "cinder-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:01:25.835625 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Lock "cinder-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:01:25.848807 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=10,cinder:SELECT=35,cinder:DELETE=2,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:01:25.995873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:26.153512 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:01:26.155009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Volume volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:01:26.176407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] deleting rbd volume volume-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:01:26.686214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Created reservations ['2161e715-6be4-4012-b88f-9eaf8f91d365', 'd3328fc9-b4dc-42f9-86ce-bf170d5a4ed9', '4c1f1337-bfa0-4471-ab75-d581ec9d7c31', '924d5cba-4c63-490f-b518-66f79fda1c15'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:01:26.828962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:26.918387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:01:26.987732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:01:26.992762 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Deleted volume successfully.
Oct 08 21:01:27.028096 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-19ffd2be-ab83-4904-9da7-e82b604bb7a8 tempest-VolumesAdminNegativeTest-557516914 None] Lock "cinder-7bdc4b7b-49a2-45d3-acde-2c3909fd91f7-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:01:42.085482 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=29,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:01:51.458936 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-701bc08f-a4be-4bd2-b968-f90bafdc3dc7 tempest-TaggedBootDevicesTest_v242-1262294407 None] Terminate volume connection completed successfully.
Oct 08 21:01:51.462462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-701bc08f-a4be-4bd2-b968-f90bafdc3dc7 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleting attachment 39284fc6-8db8-4d52-a6e1-40617452baec. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:01:51.756332 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-58158639-e8a0-413d-a4c4-5457602d2164 tempest-TaggedBootDevicesTest_v242-1262294407 None] Terminate volume connection completed successfully.
Oct 08 21:01:51.757649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-58158639-e8a0-413d-a4c4-5457602d2164 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleting attachment 25acc2e0-8a4f-4472-8efd-73907f65a5a2. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:01:52.043364 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-f4b66ebb-012f-4ccb-a9d0-6964662eede0 tempest-TaggedBootDevicesTest_v242-1262294407 None] Terminate volume connection completed successfully.
Oct 08 21:01:52.046354 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-60f2ab62-6b0d-4167-b90f-13d76c8cf0fa req-f4b66ebb-012f-4ccb-a9d0-6964662eede0 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleting attachment 88689f83-a588-4178-995b-23808101b745. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:02:02.078594 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=26,cinder:INSERT=1,cinder:UPDATE=13 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:02:02.080217 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:02:04.821710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Acquiring lock "cinder-e89fe668-7e03-49ec-be17-8fa1cabeff3c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:02:04.835543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-e89fe668-7e03-49ec-be17-8fa1cabeff3c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:02:04.900583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:05.042398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:02:05.043125 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:02:05.057087 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] deleting rbd volume volume-e89fe668-7e03-49ec-be17-8fa1cabeff3c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:02:05.475290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Created reservations ['e1d93848-41be-4fc4-9d4b-ebd12db6f2cd', 'f3084177-0588-43b5-9631-aecccb79533f', '81843415-fe80-4ead-bfae-658316cc84a1', 'd42b15e9-115b-44d2-9582-d743feb97096'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:02:05.569225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:05.657285 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:05.744052 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:02:05.750084 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleted volume successfully.
Oct 08 21:02:05.776107 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9ca84077-bf3a-4cd3-866e-ef2fd3fc8640 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-e89fe668-7e03-49ec-be17-8fa1cabeff3c-delete_volume" released by "delete_volume" :: held 0.941s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:02:05.946403 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:02:05.947315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:06.072644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:06.160407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:02:06.203975 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Acquiring lock "cinder-a9750f5d-e3dd-4b3e-a92f-9e65fda40303-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:02:06.233773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-a9750f5d-e3dd-4b3e-a92f-9e65fda40303-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:02:06.289905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:06.360780 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:02:06.361886 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:02:06.369131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] deleting rbd volume volume-a9750f5d-e3dd-4b3e-a92f-9e65fda40303 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:02:06.812871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Created reservations ['f76aee85-6321-4708-a803-5b29531b2a46', 'cbee05b3-ad15-4c34-b066-41095b196fbd', 'fd27fb36-ac55-4171-884e-4130f066fcec', 'e331aa03-ad40-4b8f-8340-80e3f80912d7'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:02:06.903570 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:06.979340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:07.079543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:02:07.141235 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleted volume successfully.
Oct 08 21:02:07.185181 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cdbb01e1-f0f3-4ffb-a50e-8631c9605632 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-a9750f5d-e3dd-4b3e-a92f-9e65fda40303-delete_volume" released by "delete_volume" :: held 0.950s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:02:07.513556 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Acquiring lock "cinder-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:02:07.525966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:02:07.608393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:07.742943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:02:07.743605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] volume has clone snapshot(s) {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1378}}
Oct 08 21:02:07.744999 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:02:07.966923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Created reservations ['9dcacac0-8e5f-4596-a8e8-b95b2354cf9e', '1f2b24b1-2412-4de1-9cb4-b1ce31f45309', '68ac7593-8d90-4ab6-a51a-c96cb98401df', '3ebf1e6a-6f61-4343-9cba-c33ece346440'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:02:08.066194 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:08.133452 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:02:08.220060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:02:08.240419 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Deleted volume successfully.
Oct 08 21:02:08.263848 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53fae84a-42ac-4a49-b0f5-4e713aab4a97 tempest-TaggedBootDevicesTest_v242-1262294407 None] Lock "cinder-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21-delete_volume" released by "delete_volume" :: held 0.738s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:02:13.840733 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa req-6b6b06f6-f8ad-4c82-8fcb-34aae0cece01 tempest-ServerRescueNegativeTestJSON-1823882791 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:02:16.244000 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa req-6b6b06f6-f8ad-4c82-8fcb-34aae0cece01 tempest-ServerRescueNegativeTestJSON-1823882791 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.403s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:02:16.244837 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa req-6b6b06f6-f8ad-4c82-8fcb-34aae0cece01 tempest-ServerRescueNegativeTestJSON-1823882791 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d9000e4-0140-4d89-9d9e-4730705b15bf', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '3d9000e4-0140-4d89-9d9e-4730705b15bf', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:02:16.324979 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa req-6b6b06f6-f8ad-4c82-8fcb-34aae0cece01 tempest-ServerRescueNegativeTestJSON-1823882791 None] Connection info returned from driver {'name': 'volumes/volume-3d9000e4-0140-4d89-9d9e-4730705b15bf', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d9000e4-0140-4d89-9d9e-4730705b15bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c7c628ae-cbd1-48b4-8b72-216fa2d1fcea'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:02:16.475124 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-098dd8ec-2633-4dd0-8fa8-45752e86e0fa req-6b6b06f6-f8ad-4c82-8fcb-34aae0cece01 tempest-ServerRescueNegativeTestJSON-1823882791 None] attachment_update completed successfully.
Oct 08 21:02:26.475884 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=45,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:02:42.079905 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=27,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:02:52.091443 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:03:02.093564 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:03:05.946439 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:03:05.948394 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:06.063698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:06.131886 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:03:12.109862 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:03:22.106434 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:03:35.203967 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-19efcf71-353d-49f4-9272-37d1d3a8bf91 req-71a5fbe4-aff5-4ab9-b0f7-609608e8559a tempest-ServerRescueNegativeTestJSON-1823882791 None] Terminate volume connection completed successfully.
Oct 08 21:03:35.205178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-19efcf71-353d-49f4-9272-37d1d3a8bf91 req-71a5fbe4-aff5-4ab9-b0f7-609608e8559a tempest-ServerRescueNegativeTestJSON-1823882791 None] Deleting attachment c7c628ae-cbd1-48b4-8b72-216fa2d1fcea. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:03:40.532885 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:03:40.565950 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Flow 'volume_create_manager' (6bd2b0c0-ce41-4d1e-85e5-7de6376642ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:03:40.576639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a2f3f5-f737-4a78-b2ad-3a92e336958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.600054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a2f3f5-f737-4a78-b2ad-3a92e336958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-177092362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2fb0d853-c668-4eb3-b56a-73cc4e960e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0310d9e59942729d685e6eb06c6460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:03:40Z,use_quota=True,user_id='5e3216124a4f41b2b931a16c750649df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.609115 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a7d5e-cadf-4708-92c7-985e9e37d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.614681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9a7d5e-cadf-4708-92c7-985e9e37d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.621005 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f948cda-589a-4af1-b7a1-d75d30628abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.625781 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f948cda-589a-4af1-b7a1-d75d30628abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'volume_name': 'volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.631114 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68617c96-9892-4873-b35c-8c98906fe320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.636542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68617c96-9892-4873-b35c-8c98906fe320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.643216 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134e2ac7-2681-4aeb-991a-27e933a51c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.655519 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Volume 2fb0d853-c668-4eb3-b56a-73cc4e960e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'volume_size': 1}
Oct 08 21:03:40.655854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] creating volume 'volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:03:40.657271 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:40.767971 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:03:40.769107 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:03:40.773360 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134e2ac7-2681-4aeb-991a-27e933a51c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.793180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e091d9f-108f-4bef-9475-5d61c1f0706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:03:40.821646 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Volume volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16 (2fb0d853-c668-4eb3-b56a-73cc4e960e16): created successfully
Oct 08 21:03:40.825480 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e091d9f-108f-4bef-9475-5d61c1f0706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:03:40.833081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Flow 'volume_create_manager' (6bd2b0c0-ce41-4d1e-85e5-7de6376642ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:03:40.869346 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e0880db0-0e77-4617-bfb8-badc345ae3fb tempest-AttachSCSIVolumeTestJSON-185688184 None] Created volume successfully.
Oct 08 21:03:43.346951 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:03:43.352566 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b req-ddbc3973-1842-4087-9706-a7387da78815 tempest-AttachSCSIVolumeTestJSON-185688184 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:03:44.786381 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b req-ddbc3973-1842-4087-9706-a7387da78815 tempest-AttachSCSIVolumeTestJSON-185688184 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.433s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:03:44.788025 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b req-ddbc3973-1842-4087-9706-a7387da78815 tempest-AttachSCSIVolumeTestJSON-185688184 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:03:44.859083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b req-ddbc3973-1842-4087-9706-a7387da78815 tempest-AttachSCSIVolumeTestJSON-185688184 None] Connection info returned from driver {'name': 'volumes/volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2fb0d853-c668-4eb3-b56a-73cc4e960e16', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4f05cecc-0d11-4dca-b98a-99fb2d462c8c'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:03:44.957986 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-500a7063-fd5b-4a87-abf4-8ee98ad1e19b req-ddbc3973-1842-4087-9706-a7387da78815 tempest-AttachSCSIVolumeTestJSON-185688184 None] attachment_update completed successfully.
Oct 08 21:03:48.590983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Acquiring lock "cinder-3d9000e4-0140-4d89-9d9e-4730705b15bf-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:03:48.609144 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Lock "cinder-3d9000e4-0140-4d89-9d9e-4730705b15bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:03:48.682016 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:48.774728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:03:48.775177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume volume-3d9000e4-0140-4d89-9d9e-4730705b15bf is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:03:48.801523 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] deleting rbd volume volume-3d9000e4-0140-4d89-9d9e-4730705b15bf {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:03:49.050078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Created reservations ['a1987d59-bd3f-41ff-8f0a-42035432b865', 'c5ac880c-39ec-4592-8767-1e88c09956e9', '0e672139-69c2-489c-b1e0-9a61e440af02', '772ee372-7ba2-47a4-9c31-2e6ad19d19fa'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:03:49.139883 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:49.229892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:49.323947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:03:49.334557 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Deleted volume successfully.
Oct 08 21:03:49.355245 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 req-dfa44414-b736-47b7-8c35-8bb9dc4645e8 tempest-AttachSCSIVolumeTestJSON-185688184 None] Terminate volume connection completed successfully.
Oct 08 21:03:49.356211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d70ed0b9-a8c3-4c84-9b8f-d49075c1b441 req-dfa44414-b736-47b7-8c35-8bb9dc4645e8 tempest-AttachSCSIVolumeTestJSON-185688184 None] Deleting attachment 4f05cecc-0d11-4dca-b98a-99fb2d462c8c. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:03:49.369430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d0bcf68e-c28e-46a6-ae50-64579b7074a7 tempest-ServerRescueNegativeTestJSON-1823882791 None] Lock "cinder-3d9000e4-0140-4d89-9d9e-4730705b15bf-delete_volume" released by "delete_volume" :: held 0.760s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:03:49.846587 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Acquiring lock "cinder-8867601a-3418-4e8c-baf2-da1a50e3ef73-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:03:49.857822 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Lock "cinder-8867601a-3418-4e8c-baf2-da1a50e3ef73-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:03:49.915427 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:49.984368 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:03:49.985360 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Volume volume-8867601a-3418-4e8c-baf2-da1a50e3ef73 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:03:49.993516 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] deleting rbd volume volume-8867601a-3418-4e8c-baf2-da1a50e3ef73 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:03:50.366936 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Created reservations ['bedf026d-1d42-4b94-a1b2-3e1efaf77b63', '67f28085-b9b8-4eef-bda2-5a437b4b3f5e', 'e7c7d21c-fab9-4ed6-8a46-6a3fd5114618', '4cbc33e5-813d-42d4-8002-24bea83bb67f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:03:50.524404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:50.609180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:50.667736 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:03:50.673777 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Deleted volume successfully.
Oct 08 21:03:50.695530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8ea41834-673d-4f06-9690-69f5147c0fc5 tempest-ServerRescueNegativeTestJSON-1823882791 None] Lock "cinder-8867601a-3418-4e8c-baf2-da1a50e3ef73-delete_volume" released by "delete_volume" :: held 0.839s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:03:59.657483 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Acquiring lock "cinder-2fb0d853-c668-4eb3-b56a-73cc4e960e16-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:03:59.675045 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Lock "cinder-2fb0d853-c668-4eb3-b56a-73cc4e960e16-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:03:59.739213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:03:59.789002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:03:59.789455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Volume volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:03:59.793089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] deleting rbd volume volume-2fb0d853-c668-4eb3-b56a-73cc4e960e16 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:03:59.955508 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Created reservations ['58e180c1-c292-42b6-93c1-8fa7f13dcefc', '671f6ff5-46f4-4c34-a4ce-d93f951a1da3', 'a21777e0-01b8-4be9-8629-8173d1a3ce92', '29ab8e97-27b0-46cf-9bb6-93efb4c8b54f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:03:59.999536 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:04:00.033320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:04:00.064705 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:04:00.069757 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Deleted volume successfully.
Oct 08 21:04:00.072290 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:DELETE=1,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:04:00.085516 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfb4e6e5-5f39-4c2d-a892-24627a400bbe tempest-AttachSCSIVolumeTestJSON-185688184 None] Lock "cinder-2fb0d853-c668-4eb3-b56a-73cc4e960e16-delete_volume" released by "delete_volume" :: held 0.410s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:04:05.947683 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:04:05.949068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:04:05.983890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:04:06.023252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:04:12.103645 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:04:22.100323 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=50,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:04:32.115787 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:04:52.103704 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:05:02.101850 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:05:05.948946 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:05:05.950497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:05:06.035654 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:05:06.110469 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:05:08.652992 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:05:08.713058 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (c8f71acd-4aab-4061-870b-2fdbd25c1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:08.733180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d08225-c28b-496d-86c6-e6ca8b7b73a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:08.777548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d08225-c28b-496d-86c6-e6ca8b7b73a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1828248158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9c63c96-d67e-46bf-97d4-00d738c11e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2d56477794f8ab38b8e3535b3e8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:05:09Z,use_quota=True,user_id='fc2bdd169daf4a1db830b1fa7f94f0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:08.790032 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090c10e-2ff9-4c31-be4d-b77c9a1f77d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:08.804674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f090c10e-2ff9-4c31-be4d-b77c9a1f77d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:08.816309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddef5437-7f35-47ee-be4f-5713582fbc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:08.949243 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddef5437-7f35-47ee-be4f-5713582fbc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9c63c96-d67e-46bf-97d4-00d738c11e05', 'volume_name': 'volume-d9c63c96-d67e-46bf-97d4-00d738c11e05', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b560460>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:08.963092 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9890d2-254f-49f3-acb3-b9dd41a091c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:08.967196 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9890d2-254f-49f3-acb3-b9dd41a091c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:08.977551 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bf81f3-89ec-48cc-ab79-3acfa67f5757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:08.979207 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Volume d9c63c96-d67e-46bf-97d4-00d738c11e05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9c63c96-d67e-46bf-97d4-00d738c11e05', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b560460>}
Oct 08 21:05:08.980059 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Cloning d9c63c96-d67e-46bf-97d4-00d738c11e05 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:05:08.982675 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:05:09.003506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:05:09.028438 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 5, 9, 14892)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:05:09.028916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:05:09.029358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:05:09.047553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:05:09.051297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:05:09.074862 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 5, 9, 58287)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:05:09.075710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:05:09.076111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:05:09.103208 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:05:09.221157 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] creating snapshot='volume-d9c63c96-d67e-46bf-97d4-00d738c11e05.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:05:09.507089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-d9c63c96-d67e-46bf-97d4-00d738c11e05.clone_snap' to 'volume-d9c63c96-d67e-46bf-97d4-00d738c11e05' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:05:09.741356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:05:09.750182 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:05:09.750556 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:05:09.790002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:05:09.792112 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Marking volume d9c63c96-d67e-46bf-97d4-00d738c11e05 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:05:09.825454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to d9c63c96-d67e-46bf-97d4-00d738c11e05. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:05:09.827038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Creating volume glance metadata for volume d9c63c96-d67e-46bf-97d4-00d738c11e05 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:05:09.996070 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bf81f3-89ec-48cc-ab79-3acfa67f5757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c63c96-d67e-46bf-97d4-00d738c11e05', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b560460>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:10.008617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3fa975-a1b5-468e-82ab-b080f94a8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:10.026912 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-d9c63c96-d67e-46bf-97d4-00d738c11e05 (d9c63c96-d67e-46bf-97d4-00d738c11e05): created successfully
Oct 08 21:05:10.031543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3fa975-a1b5-468e-82ab-b080f94a8535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:10.044927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (c8f71acd-4aab-4061-870b-2fdbd25c1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:10.059103 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ecffa683-181d-4b92-a768-19f2f8751cb7 tempest-TaggedBootDevicesTest-1568770669 None] Created volume successfully.
Oct 08 21:05:11.472351 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:05:11.532239 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (8c134dd0-ecb2-46c9-a609-562b9af1bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:11.543491 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbeda1bb-b382-4228-af0d-7f18451b4bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.581078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbeda1bb-b382-4228-af0d-7f18451b4bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1258985759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a86c82f7-9354-427c-b8fd-facabded1ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2d56477794f8ab38b8e3535b3e8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:05:11Z,use_quota=True,user_id='fc2bdd169daf4a1db830b1fa7f94f0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.597272 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351ecfdd-b7eb-48f9-ae57-c7549e28b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.605767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351ecfdd-b7eb-48f9-ae57-c7549e28b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.616894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d682974c-f240-4027-b96b-f30ad7b0cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.623213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d682974c-f240-4027-b96b-f30ad7b0cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86c82f7-9354-427c-b8fd-facabded1ea9', 'volume_name': 'volume-a86c82f7-9354-427c-b8fd-facabded1ea9', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.649899 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7fbadb-ef19-42bb-a9e7-9145cd7e4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.656357 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7fbadb-ef19-42bb-a9e7-9145cd7e4100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.677175 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c5088a-44fd-4c8b-ac27-eb336862fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.679826 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Volume a86c82f7-9354-427c-b8fd-facabded1ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86c82f7-9354-427c-b8fd-facabded1ea9', 'volume_size': 1}
Oct 08 21:05:11.684144 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] creating volume 'volume-a86c82f7-9354-427c-b8fd-facabded1ea9' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:05:11.685266 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:05:11.822147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:05:11.824062 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:05:11.831523 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c5088a-44fd-4c8b-ac27-eb336862fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86c82f7-9354-427c-b8fd-facabded1ea9', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.844656 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab96bdfd-ac80-464a-b937-99d30911ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:11.886777 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-a86c82f7-9354-427c-b8fd-facabded1ea9 (a86c82f7-9354-427c-b8fd-facabded1ea9): created successfully
Oct 08 21:05:11.892368 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab96bdfd-ac80-464a-b937-99d30911ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:11.898098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (8c134dd0-ecb2-46c9-a609-562b9af1bda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:11.918495 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-bb6af8fe-ef35-45b0-9346-b47850a3ea81 tempest-TaggedBootDevicesTest-1568770669 None] Created volume successfully.
Oct 08 21:05:12.991150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:05:13.022687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (2543abef-4fe7-4979-95c5-949630f8461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:13.031160 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e9dddc-8110-46fd-8c73-a9e8bb7bf804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.058463 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e9dddc-8110-46fd-8c73-a9e8bb7bf804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1361668380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1082d721-8d03-4d1a-a930-7e3c44810f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2d56477794f8ab38b8e3535b3e8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:05:13Z,use_quota=True,user_id='fc2bdd169daf4a1db830b1fa7f94f0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.066656 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd41aa4f-1960-4b26-a48b-04608fdcae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.071621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd41aa4f-1960-4b26-a48b-04608fdcae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.079616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f258be5a-62ca-4382-a917-245eaff97f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.090556 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f258be5a-62ca-4382-a917-245eaff97f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1082d721-8d03-4d1a-a930-7e3c44810f2d', 'volume_name': 'volume-1082d721-8d03-4d1a-a930-7e3c44810f2d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.096165 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7906459-e682-467f-846c-26a8f29e4057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.102235 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7906459-e682-467f-846c-26a8f29e4057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.108392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf3b22b-238d-43bc-8ba8-c1d3c7907ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.110984 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Volume 1082d721-8d03-4d1a-a930-7e3c44810f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1082d721-8d03-4d1a-a930-7e3c44810f2d', 'volume_size': 1}
Oct 08 21:05:13.113319 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] creating volume 'volume-1082d721-8d03-4d1a-a930-7e3c44810f2d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:05:13.114202 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:05:13.242681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:05:13.243379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:05:13.248093 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf3b22b-238d-43bc-8ba8-c1d3c7907ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1082d721-8d03-4d1a-a930-7e3c44810f2d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.267952 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901198de-069f-4e20-841c-1a44e2a038a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:05:13.288809 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-1082d721-8d03-4d1a-a930-7e3c44810f2d (1082d721-8d03-4d1a-a930-7e3c44810f2d): created successfully
Oct 08 21:05:13.292940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901198de-069f-4e20-841c-1a44e2a038a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:05:13.301456 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Flow 'volume_create_manager' (2543abef-4fe7-4979-95c5-949630f8461b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:05:13.315655 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-433bcc11-50fd-4ba5-8104-82ab4e6e26ea tempest-TaggedBootDevicesTest-1568770669 None] Created volume successfully.
Oct 08 21:05:22.115009 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:05:42.116146 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=33,cinder:UPDATE=8,cinder:INSERT=12,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:05:47.829350 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-1a71e5b6-dfb9-4567-8739-8107df2deba0 tempest-TaggedBootDevicesTest-1568770669 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:05:49.054704 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-1a71e5b6-dfb9-4567-8739-8107df2deba0 tempest-TaggedBootDevicesTest-1568770669 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.229s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:05:49.055529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-1a71e5b6-dfb9-4567-8739-8107df2deba0 tempest-TaggedBootDevicesTest-1568770669 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9c63c96-d67e-46bf-97d4-00d738c11e05', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd9c63c96-d67e-46bf-97d4-00d738c11e05', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:05:49.127900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-1a71e5b6-dfb9-4567-8739-8107df2deba0 tempest-TaggedBootDevicesTest-1568770669 None] Connection info returned from driver {'name': 'volumes/volume-d9c63c96-d67e-46bf-97d4-00d738c11e05', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9c63c96-d67e-46bf-97d4-00d738c11e05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c8dc52a0-a9d1-41d2-83d4-9fab020e73dc'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:05:49.278584 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-1a71e5b6-dfb9-4567-8739-8107df2deba0 tempest-TaggedBootDevicesTest-1568770669 None] attachment_update completed successfully.
Oct 08 21:05:49.856331 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-8b6006e7-fda2-4787-9c94-72d604ef2fa6 tempest-TaggedBootDevicesTest-1568770669 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:05:51.216963 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-8b6006e7-fda2-4787-9c94-72d604ef2fa6 tempest-TaggedBootDevicesTest-1568770669 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.362s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:05:51.217936 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-8b6006e7-fda2-4787-9c94-72d604ef2fa6 tempest-TaggedBootDevicesTest-1568770669 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a86c82f7-9354-427c-b8fd-facabded1ea9', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'a86c82f7-9354-427c-b8fd-facabded1ea9', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:05:51.270843 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-8b6006e7-fda2-4787-9c94-72d604ef2fa6 tempest-TaggedBootDevicesTest-1568770669 None] Connection info returned from driver {'name': 'volumes/volume-a86c82f7-9354-427c-b8fd-facabded1ea9', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a86c82f7-9354-427c-b8fd-facabded1ea9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1a8f5b17-670f-40e4-b09e-1988fab3c7ab'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:05:51.377900 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-8b6006e7-fda2-4787-9c94-72d604ef2fa6 tempest-TaggedBootDevicesTest-1568770669 None] attachment_update completed successfully.
Oct 08 21:05:51.906636 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-b176d6a9-daa4-4ec5-8213-012db65b70a6 tempest-TaggedBootDevicesTest-1568770669 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:05:53.195854 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-b176d6a9-daa4-4ec5-8213-012db65b70a6 tempest-TaggedBootDevicesTest-1568770669 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.292s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:05:53.198008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-b176d6a9-daa4-4ec5-8213-012db65b70a6 tempest-TaggedBootDevicesTest-1568770669 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1082d721-8d03-4d1a-a930-7e3c44810f2d', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '1082d721-8d03-4d1a-a930-7e3c44810f2d', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:05:53.227905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-b176d6a9-daa4-4ec5-8213-012db65b70a6 tempest-TaggedBootDevicesTest-1568770669 None] Connection info returned from driver {'name': 'volumes/volume-1082d721-8d03-4d1a-a930-7e3c44810f2d', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1082d721-8d03-4d1a-a930-7e3c44810f2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4f4a5811-1c29-4ee8-9a64-70311df29ea4'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:05:53.338302 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-205f44bf-3f3e-4a11-aac3-ef78becaeea8 req-b176d6a9-daa4-4ec5-8213-012db65b70a6 tempest-TaggedBootDevicesTest-1568770669 None] attachment_update completed successfully.
Oct 08 21:06:03.332558 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=36,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:06:05.945880 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:06:05.946823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:06:06.006646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:06:06.092695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:06:06.357283 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=36,cinder:UPDATE=9 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:06:06.375307 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:06:06.411129 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Flow 'volume_create_manager' (d4f9625a-e359-493b-ae97-d7f94723fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:06:06.424493 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f4497-9731-4030-badc-ea1aa849062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.452149 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f4497-9731-4030-badc-ea1aa849062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1988212013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=31e209f5-1092-4499-a719-01507df30223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665f66e846c24a6db01274679100bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:06:06Z,use_quota=True,user_id='21870fe169dc42359d9bdb149d0016d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.458126 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee03e0fa-52a7-4892-b7c0-406be100d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.469924 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee03e0fa-52a7-4892-b7c0-406be100d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.498846 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4cac14-34cc-41bb-86c1-6733b840a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.504035 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4cac14-34cc-41bb-86c1-6733b840a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e209f5-1092-4499-a719-01507df30223', 'volume_name': 'volume-31e209f5-1092-4499-a719-01507df30223', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.510481 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0010a6-9939-4d96-bc84-6f9e76c81a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.514667 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0010a6-9939-4d96-bc84-6f9e76c81a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.520514 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c9389c-083a-4240-b3e5-0e323a9113e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.523914 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume 31e209f5-1092-4499-a719-01507df30223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e209f5-1092-4499-a719-01507df30223', 'volume_size': 1}
Oct 08 21:06:06.525948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] creating volume 'volume-31e209f5-1092-4499-a719-01507df30223' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:06:06.527565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:06:06.693209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:06:06.693889 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:06:06.697593 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c9389c-083a-4240-b3e5-0e323a9113e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e209f5-1092-4499-a719-01507df30223', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.710204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6661b48e-11cd-4b71-b37c-fb3e0512bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:06.736959 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume volume-31e209f5-1092-4499-a719-01507df30223 (31e209f5-1092-4499-a719-01507df30223): created successfully
Oct 08 21:06:06.746766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6661b48e-11cd-4b71-b37c-fb3e0512bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:06.759670 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Flow 'volume_create_manager' (d4f9625a-e359-493b-ae97-d7f94723fc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:06:06.779091 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9b4b0765-b701-4972-8626-1377509bab48 tempest-AttachVolumeShelveTestJSON-1179861839 None] Created volume successfully.
Oct 08 21:06:32.130192 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:06:35.484037 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:06:35.540842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (b32f6f73-e684-4a40-af35-ee3a4a409b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:06:35.580365 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522056a1-e5fa-428e-bc50-7ae85883e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.640766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522056a1-e5fa-428e-bc50-7ae85883e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1293387693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b9d2f56-8742-40d7-8421-fb2664f4d10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68b14967e8249fd886f168d366f241f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:06:35Z,use_quota=True,user_id='85abb492492343c58734564a2b26c8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:35.650534 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2f7caa-cf67-48f8-9f9a-5f8093964355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.658699 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2f7caa-cf67-48f8-9f9a-5f8093964355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:35.676142 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5850b0c-9f45-415f-b57f-bbc0ee84b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.685827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5850b0c-9f45-415f-b57f-bbc0ee84b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'volume_name': 'volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:35.696756 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31353f7-2fa4-4821-a760-29a8afd1b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.706734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31353f7-2fa4-4821-a760-29a8afd1b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:35.723709 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6cb07f-d70f-4570-9188-74e62d2f8f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.726525 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Volume 2b9d2f56-8742-40d7-8421-fb2664f4d10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'volume_size': 1}
Oct 08 21:06:35.727988 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] creating volume 'volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:06:35.734039 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:06:35.900791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:06:35.901473 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:06:35.905836 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6cb07f-d70f-4570-9188-74e62d2f8f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:35.921879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f41c67-77e9-4587-959a-50ebc5660623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:06:35.968166 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e (2b9d2f56-8742-40d7-8421-fb2664f4d10e): created successfully
Oct 08 21:06:35.983161 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f41c67-77e9-4587-959a-50ebc5660623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:06:36.011427 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (b32f6f73-e684-4a40-af35-ee3a4a409b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:06:36.038435 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e7a4eb09-1aca-4d22-ae12-ac539c7f57f9 tempest-AttachVolumeTestJSON-2043566449 None] Created volume successfully.
Oct 08 21:06:37.874024 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:06:37.920586 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-3cc8cb09-43a4-4586-b8b9-babb316fc80e req-eda578a9-5e73-4240-836a-a66d5b4c59cf tempest-AttachVolumeTestJSON-2043566449 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:06:39.887615 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-3cc8cb09-43a4-4586-b8b9-babb316fc80e req-eda578a9-5e73-4240-836a-a66d5b4c59cf tempest-AttachVolumeTestJSON-2043566449 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.969s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:06:39.888478 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-3cc8cb09-43a4-4586-b8b9-babb316fc80e req-eda578a9-5e73-4240-836a-a66d5b4c59cf tempest-AttachVolumeTestJSON-2043566449 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:06:39.959221 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-3cc8cb09-43a4-4586-b8b9-babb316fc80e req-eda578a9-5e73-4240-836a-a66d5b4c59cf tempest-AttachVolumeTestJSON-2043566449 None] Connection info returned from driver {'name': 'volumes/volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2b9d2f56-8742-40d7-8421-fb2664f4d10e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bbd7e904-2733-4f09-8192-79fccb3131ce'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:06:40.039154 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-3cc8cb09-43a4-4586-b8b9-babb316fc80e req-eda578a9-5e73-4240-836a-a66d5b4c59cf tempest-AttachVolumeTestJSON-2043566449 None] attachment_update completed successfully.
Oct 08 21:07:05.949161 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:07:05.950862 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:07:06.033701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:07:06.092957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:07:06.130495 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=22,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:07:06.166595 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1fb4118c-78e0-4772-9c10-eaff6397658b req-088df39f-7862-4342-a389-05ca28b3a60a tempest-AttachVolumeShelveTestJSON-1179861839 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:07:07.225922 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1fb4118c-78e0-4772-9c10-eaff6397658b req-088df39f-7862-4342-a389-05ca28b3a60a tempest-AttachVolumeShelveTestJSON-1179861839 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.059s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:07:07.227380 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1fb4118c-78e0-4772-9c10-eaff6397658b req-088df39f-7862-4342-a389-05ca28b3a60a tempest-AttachVolumeShelveTestJSON-1179861839 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-31e209f5-1092-4499-a719-01507df30223', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '31e209f5-1092-4499-a719-01507df30223', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:07:07.266237 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-1fb4118c-78e0-4772-9c10-eaff6397658b req-088df39f-7862-4342-a389-05ca28b3a60a tempest-AttachVolumeShelveTestJSON-1179861839 None] Connection info returned from driver {'name': 'volumes/volume-31e209f5-1092-4499-a719-01507df30223', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '31e209f5-1092-4499-a719-01507df30223', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26772436-ddad-41f3-8d9f-23444d14bd89'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:07:07.333369 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-1fb4118c-78e0-4772-9c10-eaff6397658b req-088df39f-7862-4342-a389-05ca28b3a60a tempest-AttachVolumeShelveTestJSON-1179861839 None] attachment_update completed successfully.
Oct 08 21:07:17.331967 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=28,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:07:32.125956 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:07:36.063172 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-7aafab09-9ede-407d-ae9d-088ed03ace9a req-c3e84bfe-fbf8-4e31-a1f9-1a54a467908b tempest-AttachVolumeTestJSON-2043566449 None] Terminate volume connection completed successfully.
Oct 08 21:07:36.063172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-7aafab09-9ede-407d-ae9d-088ed03ace9a req-c3e84bfe-fbf8-4e31-a1f9-1a54a467908b tempest-AttachVolumeTestJSON-2043566449 None] Deleting attachment bbd7e904-2733-4f09-8192-79fccb3131ce. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:07:52.136227 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:08:05.954453 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:08:05.956843 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:08:06.034755 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:08:06.128163 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:08:12.128932 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:08:13.313827 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba req-ac26df4b-452d-44d7-b634-74552af9dd21 tempest-AttachVolumeShelveTestJSON-1179861839 None] Terminate volume connection completed successfully.
Oct 08 21:08:13.315795 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-cd40d284-0ca5-4bcb-9e2c-b2a5644fe2ba req-ac26df4b-452d-44d7-b634-74552af9dd21 tempest-AttachVolumeShelveTestJSON-1179861839 None] Deleting attachment 26772436-ddad-41f3-8d9f-23444d14bd89. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:08:15.341675 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:08:15.412727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Flow 'volume_create_manager' (ee81519e-9be4-4f31-86f2-35529dad4f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:08:15.435138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172756a-ea61-4840-81a8-0fcbadbb5d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.465778 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172756a-ea61-4840-81a8-0fcbadbb5d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1354116286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d22df1a4-c142-4980-a855-4b5f1733fd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765c62cac2ee4406b23a5baa85c52ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:08:15Z,use_quota=True,user_id='d78e9afd772c4de981cac8f5817ec356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.475040 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6b3d1c-4dee-45be-ab01-7e4f3cea05e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.486446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6b3d1c-4dee-45be-ab01-7e4f3cea05e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.497020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd09b6d-2729-45d1-9290-42d77b16db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.506158 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd09b6d-2729-45d1-9290-42d77b16db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22df1a4-c142-4980-a855-4b5f1733fd4d', 'volume_name': 'volume-d22df1a4-c142-4980-a855-4b5f1733fd4d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.518536 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ca638-c4ac-466a-b276-e4a6eb75ae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.524984 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ca638-c4ac-466a-b276-e4a6eb75ae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.534757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39482994-9cd9-4085-8efb-873c29cef96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.536198 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Volume d22df1a4-c142-4980-a855-4b5f1733fd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22df1a4-c142-4980-a855-4b5f1733fd4d', 'volume_size': 1}
Oct 08 21:08:15.536759 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] creating volume 'volume-d22df1a4-c142-4980-a855-4b5f1733fd4d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:08:15.546046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:08:15.705145 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:08:15.706020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:08:15.711546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39482994-9cd9-4085-8efb-873c29cef96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22df1a4-c142-4980-a855-4b5f1733fd4d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.718002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2ce198-91be-4bad-b93f-7e447a400edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:08:15.733238 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Volume volume-d22df1a4-c142-4980-a855-4b5f1733fd4d (d22df1a4-c142-4980-a855-4b5f1733fd4d): created successfully
Oct 08 21:08:15.739580 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2ce198-91be-4bad-b93f-7e447a400edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:08:15.750821 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Flow 'volume_create_manager' (ee81519e-9be4-4f31-86f2-35529dad4f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:08:15.769356 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4192ea0f-46cd-4430-9122-d51ffa79a7db tempest-DeleteServersTestJSON-1423663413 None] Created volume successfully.
Oct 08 21:08:18.607072 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 req-09952c29-cf97-492e-8dce-0c154185291c tempest-DeleteServersTestJSON-1423663413 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:08:20.283840 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 req-09952c29-cf97-492e-8dce-0c154185291c tempest-DeleteServersTestJSON-1423663413 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.677s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:08:20.284972 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 req-09952c29-cf97-492e-8dce-0c154185291c tempest-DeleteServersTestJSON-1423663413 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d22df1a4-c142-4980-a855-4b5f1733fd4d', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd22df1a4-c142-4980-a855-4b5f1733fd4d', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:08:20.339683 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 req-09952c29-cf97-492e-8dce-0c154185291c tempest-DeleteServersTestJSON-1423663413 None] Connection info returned from driver {'name': 'volumes/volume-d22df1a4-c142-4980-a855-4b5f1733fd4d', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd22df1a4-c142-4980-a855-4b5f1733fd4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe718332-89f2-499e-bbeb-4e095836cef1'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:08:20.470448 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-fbc152b7-f8f1-42a1-bfa7-0da5e143fec8 req-09952c29-cf97-492e-8dce-0c154185291c tempest-DeleteServersTestJSON-1423663413 None] attachment_update completed successfully.
Oct 08 21:08:27.631630 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:08:27.636882 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-3c31c560-aa37-4e2a-8da4-afc13da248a4 req-9c1a67df-4a9b-4079-a3ba-f2a2ddb41a94 tempest-DeleteServersTestJSON-1423663413 None] Terminate volume connection completed successfully.
Oct 08 21:08:27.637491 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-3c31c560-aa37-4e2a-8da4-afc13da248a4 req-9c1a67df-4a9b-4079-a3ba-f2a2ddb41a94 tempest-DeleteServersTestJSON-1423663413 None] Deleting attachment fe718332-89f2-499e-bbeb-4e095836cef1. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:08:42.147376 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=21,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:09:02.147350 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:09:05.959438 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:09:05.961220 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:06.055277 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:06.120978 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:09:22.145118 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:09:23.389370 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:09:23.450176 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Flow 'volume_create_manager' (d61170ff-38e9-4d75-85c3-3e8b27c2e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:23.464608 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbe391e-b9ec-4fd2-a2c0-485bea7082ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.500446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbe391e-b9ec-4fd2-a2c0-485bea7082ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1486351570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4c6e466-2adb-4dc5-88bc-47c1969a8c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665f66e846c24a6db01274679100bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:09:23Z,use_quota=True,user_id='21870fe169dc42359d9bdb149d0016d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.506716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1fa93-bb6f-4a14-aef8-04841eca0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.512174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1fa93-bb6f-4a14-aef8-04841eca0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.518646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b731734-3870-4e4a-96a6-322541941b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.523217 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b731734-3870-4e4a-96a6-322541941b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c6e466-2adb-4dc5-88bc-47c1969a8c8d', 'volume_name': 'volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.529097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50f31b-affe-44d7-b5c2-78bc4ec36786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.539566 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50f31b-affe-44d7-b5c2-78bc4ec36786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.544940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d224ffc9-a50c-49b2-9722-2420590dce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.546248 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume f4c6e466-2adb-4dc5-88bc-47c1969a8c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d', 'volume_size': 1}
Oct 08 21:09:23.546797 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] creating volume 'volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:09:23.547623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:23.679299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:09:23.679678 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:09:23.684352 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d224ffc9-a50c-49b2-9722-2420590dce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.694989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63edb15-7a81-432a-94ed-95b3b987ea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:23.710190 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d (f4c6e466-2adb-4dc5-88bc-47c1969a8c8d): created successfully
Oct 08 21:09:23.717709 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63edb15-7a81-432a-94ed-95b3b987ea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:23.725985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Flow 'volume_create_manager' (d61170ff-38e9-4d75-85c3-3e8b27c2e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:23.740130 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ecab5a5e-8f17-4ee4-b183-201100e733a9 tempest-AttachVolumeShelveTestJSON-1179861839 None] Created volume successfully.
Oct 08 21:09:27.009917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:09:27.051331 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Flow 'volume_create_manager' (879391f1-1ab9-4bfb-8a8f-fe7c05fb1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:27.065450 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cce8ea-7252-49b6-a8ab-2feef5b72985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.109521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cce8ea-7252-49b6-a8ab-2feef5b72985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1538654800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dba60c3d-e3db-4e3c-be55-9d95fad53c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae02675057e4f27bc1980348afc8ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:09:27Z,use_quota=True,user_id='6a78d352c143483c8e4702d789d4c516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.116592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df027a0-8ae9-453b-afd2-ea2daf898faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.124729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df027a0-8ae9-453b-afd2-ea2daf898faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.131207 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5274211c-1643-4c66-85af-d01576f8dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.141958 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5274211c-1643-4c66-85af-d01576f8dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba60c3d-e3db-4e3c-be55-9d95fad53c72', 'volume_name': 'volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.151122 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2c4c7f-226e-430a-9fed-39d284f25c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.155586 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2c4c7f-226e-430a-9fed-39d284f25c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.160595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8c90db-51fa-43c3-8482-8848c0947d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.161947 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Volume dba60c3d-e3db-4e3c-be55-9d95fad53c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72', 'volume_size': 1}
Oct 08 21:09:27.166368 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] creating volume 'volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:09:27.167265 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:27.367921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:09:27.368329 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:09:27.376644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b8c90db-51fa-43c3-8482-8848c0947d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.393031 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c698a2-19d6-49dc-a634-51bb07cc2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:27.413631 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Volume volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72 (dba60c3d-e3db-4e3c-be55-9d95fad53c72): created successfully
Oct 08 21:09:27.420432 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c698a2-19d6-49dc-a634-51bb07cc2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:27.446022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Flow 'volume_create_manager' (879391f1-1ab9-4bfb-8a8f-fe7c05fb1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:27.480004 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f99b9696-432e-4cc9-9d9b-b8cae7d64072 tempest-ServersNegativeTestJSON-1441071354 None] Created volume successfully.
Oct 08 21:09:29.982432 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:09:30.032695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Flow 'volume_create_manager' (b889dc0f-27bb-4bf7-be1c-fe213727165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:30.047327 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab03dcf-f102-41aa-9e4f-8527c1950923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.085954 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab03dcf-f102-41aa-9e4f-8527c1950923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1940720612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e7dcb6a-067d-4bd6-99c7-b38b6877dca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae02675057e4f27bc1980348afc8ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:09:30Z,use_quota=True,user_id='6a78d352c143483c8e4702d789d4c516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.107594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57f9b8-502d-4ddb-aff1-ae3574995ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.120966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57f9b8-502d-4ddb-aff1-ae3574995ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.129939 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f578bd28-f950-44d7-9e38-3ee2beb9bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.136767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f578bd28-f950-44d7-9e38-3ee2beb9bc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7dcb6a-067d-4bd6-99c7-b38b6877dca2', 'volume_name': 'volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.155844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5791fc8-8d39-45b9-bd4a-9437014d0edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.161907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5791fc8-8d39-45b9-bd4a-9437014d0edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.168150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1905287-fccf-4e36-a65e-d94cbe412104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.170033 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Volume 0e7dcb6a-067d-4bd6-99c7-b38b6877dca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2', 'volume_size': 1}
Oct 08 21:09:30.170731 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] creating volume 'volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:09:30.171753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:30.305806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:09:30.306600 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:09:30.317418 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1905287-fccf-4e36-a65e-d94cbe412104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.325868 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b2001f-4aeb-4380-8151-72ca3a5472a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:30.343334 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Volume volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2 (0e7dcb6a-067d-4bd6-99c7-b38b6877dca2): created successfully
Oct 08 21:09:30.361130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b2001f-4aeb-4380-8151-72ca3a5472a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:30.376611 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Flow 'volume_create_manager' (b889dc0f-27bb-4bf7-be1c-fe213727165b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:30.407671 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-562055f4-bf35-4dbd-a862-c3e9738d9ccf tempest-ServersNegativeTestJSON-1441071354 None] Created volume successfully.
Oct 08 21:09:42.155951 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:09:49.507340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:09:49.557172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (f3616a2a-4a94-44a8-8572-b74439f896ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:49.578476 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e899709-bc81-4542-9719-bfd1cdbdfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.613422 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e899709-bc81-4542-9719-bfd1cdbdfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1174692319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1dddb5cf-401e-4276-b7d2-76b0ba48acc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68b14967e8249fd886f168d366f241f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:09:49Z,use_quota=True,user_id='85abb492492343c58734564a2b26c8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.631576 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b03c16d-dd12-4ec4-a4dc-dd7c6c31d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.640033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b03c16d-dd12-4ec4-a4dc-dd7c6c31d573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.650086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad478e9c-ce0c-4dbd-bcf0-ea074b019243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.655553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad478e9c-ce0c-4dbd-bcf0-ea074b019243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'volume_name': 'volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.663295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802bd37c-204e-422a-912a-770d6201b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.678559 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802bd37c-204e-422a-912a-770d6201b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.686422 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636e198f-f8eb-4be4-bdad-c1dea3ba8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.687900 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Volume 1dddb5cf-401e-4276-b7d2-76b0ba48acc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'volume_size': 1}
Oct 08 21:09:49.688706 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] creating volume 'volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:09:49.689708 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:49.858461 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:09:49.859082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:09:49.863132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636e198f-f8eb-4be4-bdad-c1dea3ba8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.877261 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d6869-4a2f-409c-a0f3-7263f9cbcc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:49.904632 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7 (1dddb5cf-401e-4276-b7d2-76b0ba48acc7): created successfully
Oct 08 21:09:49.915137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d6869-4a2f-409c-a0f3-7263f9cbcc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:49.921050 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (f3616a2a-4a94-44a8-8572-b74439f896ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:49.944010 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7dee2b45-7820-40c3-b439-b8fffa4f4c6e tempest-AttachVolumeTestJSON-2043566449 None] Created volume successfully.
Oct 08 21:09:52.040999 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-edf57666-0c6f-4074-bd83-ef7686cb6a1b req-d6cec394-57f7-40a5-8759-0457ce4c221c tempest-AttachVolumeTestJSON-2043566449 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:09:53.906007 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-edf57666-0c6f-4074-bd83-ef7686cb6a1b req-d6cec394-57f7-40a5-8759-0457ce4c221c tempest-AttachVolumeTestJSON-2043566449 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.865s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:09:53.910178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-edf57666-0c6f-4074-bd83-ef7686cb6a1b req-d6cec394-57f7-40a5-8759-0457ce4c221c tempest-AttachVolumeTestJSON-2043566449 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:09:53.922779 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:09:53.993651 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-edf57666-0c6f-4074-bd83-ef7686cb6a1b req-d6cec394-57f7-40a5-8759-0457ce4c221c tempest-AttachVolumeTestJSON-2043566449 None] Connection info returned from driver {'name': 'volumes/volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1dddb5cf-401e-4276-b7d2-76b0ba48acc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '689b2eaa-f6c3-47b3-aa61-bbe5992fa734'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:09:54.172299 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-edf57666-0c6f-4074-bd83-ef7686cb6a1b req-d6cec394-57f7-40a5-8759-0457ce4c221c tempest-AttachVolumeTestJSON-2043566449 None] attachment_update completed successfully.
Oct 08 21:09:58.591970 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:09:58.636344 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (09ddeaa4-b88f-4335-a6f2-db9d9b5f8e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:58.644224 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eae4376-60d0-4ed6-a46f-9e9ef48dc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.667948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eae4376-60d0-4ed6-a46f-9e9ef48dc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1286969320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab61ecb6-055f-430c-913d-93288fd4b038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68b14967e8249fd886f168d366f241f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:09:58Z,use_quota=True,user_id='85abb492492343c58734564a2b26c8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.681543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceb820b-c323-47dd-b53a-da9e0588da1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.693891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceb820b-c323-47dd-b53a-da9e0588da1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.712627 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eb65d7-b1a9-44fe-80e9-49ce39ba7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.727058 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eb65d7-b1a9-44fe-80e9-49ce39ba7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab61ecb6-055f-430c-913d-93288fd4b038', 'volume_name': 'volume-ab61ecb6-055f-430c-913d-93288fd4b038', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.734203 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22865731-5054-46d0-a22b-9fbe85d5cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.762117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22865731-5054-46d0-a22b-9fbe85d5cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.769467 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0273dd5a-0a8e-46f2-87d6-cfe0dfa7e298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.770857 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Volume ab61ecb6-055f-430c-913d-93288fd4b038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab61ecb6-055f-430c-913d-93288fd4b038', 'volume_size': 1}
Oct 08 21:09:58.771434 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] creating volume 'volume-ab61ecb6-055f-430c-913d-93288fd4b038' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:09:58.772384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:09:58.935195 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:09:58.935862 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:09:58.939715 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0273dd5a-0a8e-46f2-87d6-cfe0dfa7e298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab61ecb6-055f-430c-913d-93288fd4b038', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.948524 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babe63f6-ea4d-478d-8f79-009bfc0f8c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:09:58.978699 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-ab61ecb6-055f-430c-913d-93288fd4b038 (ab61ecb6-055f-430c-913d-93288fd4b038): created successfully
Oct 08 21:09:58.982826 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babe63f6-ea4d-478d-8f79-009bfc0f8c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:09:58.999594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Flow 'volume_create_manager' (09ddeaa4-b88f-4335-a6f2-db9d9b5f8e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:09:59.031330 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3ccae04e-70e1-4168-98ba-4f71de4f7b28 tempest-AttachVolumeTestJSON-2043566449 None] Created volume successfully.
Oct 08 21:10:01.101272 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-82235410-caeb-4771-9441-9c56ae4fc35d req-79d2469f-8b5b-41a0-ab81-a3dceef350b0 tempest-AttachVolumeTestJSON-2043566449 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:10:02.719800 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-82235410-caeb-4771-9441-9c56ae4fc35d req-79d2469f-8b5b-41a0-ab81-a3dceef350b0 tempest-AttachVolumeTestJSON-2043566449 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.644s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:10:02.720832 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-82235410-caeb-4771-9441-9c56ae4fc35d req-79d2469f-8b5b-41a0-ab81-a3dceef350b0 tempest-AttachVolumeTestJSON-2043566449 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ab61ecb6-055f-430c-913d-93288fd4b038', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'ab61ecb6-055f-430c-913d-93288fd4b038', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:10:02.786827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-82235410-caeb-4771-9441-9c56ae4fc35d req-79d2469f-8b5b-41a0-ab81-a3dceef350b0 tempest-AttachVolumeTestJSON-2043566449 None] Connection info returned from driver {'name': 'volumes/volume-ab61ecb6-055f-430c-913d-93288fd4b038', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ab61ecb6-055f-430c-913d-93288fd4b038', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ad372bbf-471a-49e6-a737-e06937055d6a'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:10:02.938872 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-82235410-caeb-4771-9441-9c56ae4fc35d req-79d2469f-8b5b-41a0-ab81-a3dceef350b0 tempest-AttachVolumeTestJSON-2043566449 None] attachment_update completed successfully.
Oct 08 21:10:05.955902 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:10:05.957420 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:06.057069 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:06.126230 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:10:08.014936 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-9bc8dd77-c059-47b1-aa24-640e13111600 req-ad1b023f-cff7-484b-bab6-f7b3b4ee6b85 tempest-AttachVolumeTestJSON-2043566449 None] Terminate volume connection completed successfully.
Oct 08 21:10:08.016030 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-9bc8dd77-c059-47b1-aa24-640e13111600 req-ad1b023f-cff7-484b-bab6-f7b3b4ee6b85 tempest-AttachVolumeTestJSON-2043566449 None] Deleting attachment 689b2eaa-f6c3-47b3-aa61-bbe5992fa734. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:11.282321 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 req-55f29a58-c3e4-429b-9659-73c5f07cd356 tempest-AttachVolumeTestJSON-2043566449 None] Terminate volume connection completed successfully.
Oct 08 21:10:11.283550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-e1db3a2e-5dbf-4e6d-9133-f17eba1a5ea9 req-55f29a58-c3e4-429b-9659-73c5f07cd356 tempest-AttachVolumeTestJSON-2043566449 None] Deleting attachment ad372bbf-471a-49e6-a737-e06937055d6a. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:14.479992 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=43,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:10:14.494315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-52b9f34f-a4cb-4025-94aa-804d39033bb7 req-6b97ddd6-82bd-4bf4-a154-deba067bfd74 tempest-AttachVolumeShelveTestJSON-1179861839 None] No connector for attachment e482c84c-6926-4876-8bb5-f7d1e0713baf; skipping storage backend terminate_connection call. {{(pid=133344) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}}
Oct 08 21:10:14.494734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-52b9f34f-a4cb-4025-94aa-804d39033bb7 req-6b97ddd6-82bd-4bf4-a154-deba067bfd74 tempest-AttachVolumeShelveTestJSON-1179861839 None] Deleting attachment e482c84c-6926-4876-8bb5-f7d1e0713baf. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:32.152315 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:10:32.535053 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Acquiring lock "cinder-ab61ecb6-055f-430c-913d-93288fd4b038-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:10:32.563301 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-ab61ecb6-055f-430c-913d-93288fd4b038-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:10:32.705974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:32.859342 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:10:32.859778 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-ab61ecb6-055f-430c-913d-93288fd4b038 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:10:32.871871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] deleting rbd volume volume-ab61ecb6-055f-430c-913d-93288fd4b038 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:10:33.305634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Created reservations ['ffb0acfb-8929-4bb6-86c7-11996f3eb497', '28cb6f98-8c13-4d98-b340-06e1baac5021', '168de475-5da8-4198-8d4b-3d4ccf3fab37', '92dbaac2-323a-4eba-8955-b17d912d02ef'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:10:33.420566 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:33.549337 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:33.659278 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:10:33.663244 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Deleted volume successfully.
Oct 08 21:10:33.678419 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-35fe8019-a219-4753-942f-2616a4ab4ab1 tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-ab61ecb6-055f-430c-913d-93288fd4b038-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:10:34.018652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Acquiring lock "cinder-1dddb5cf-401e-4276-b7d2-76b0ba48acc7-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:10:34.037549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-1dddb5cf-401e-4276-b7d2-76b0ba48acc7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:10:34.144209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:34.229160 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:10:34.229766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:10:34.240255 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] deleting rbd volume volume-1dddb5cf-401e-4276-b7d2-76b0ba48acc7 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:10:34.691438 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Created reservations ['2af9a2b6-dec2-41f3-94c4-14b22abe8410', '1a913337-6ba3-4324-b221-1df1071f10e4', 'ebd00f72-cfd1-46e6-8c81-b49c3ff6fc6a', '69e2d865-83ac-445e-a78e-b6c4c42ef1e3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:10:34.839386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:34.929943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:34.997253 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:10:35.003993 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Deleted volume successfully.
Oct 08 21:10:35.026575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-74eb0935-e03c-4fb5-a7cf-f74cf3032c1e tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-1dddb5cf-401e-4276-b7d2-76b0ba48acc7-delete_volume" released by "delete_volume" :: held 0.989s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:10:36.569740 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Acquiring lock "cinder-2b9d2f56-8742-40d7-8421-fb2664f4d10e-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:10:36.584495 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-2b9d2f56-8742-40d7-8421-fb2664f4d10e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:10:36.712036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:36.838246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:10:36.838779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Volume volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:10:36.848772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] deleting rbd volume volume-2b9d2f56-8742-40d7-8421-fb2664f4d10e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:10:37.187210 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Created reservations ['9986c71c-3d5a-4da1-a4aa-a3986d2fc205', 'b1ac75dd-c77e-4305-a4c5-bba43a6bcd7d', '4de618e2-2a6a-481d-b7b7-304fecff3a54', 'b6d815f2-b889-4a2e-9c21-1b322402c97a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:10:37.297492 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:37.365573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:37.449617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:10:37.454685 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Deleted volume successfully.
Oct 08 21:10:37.480973 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-149f9832-80b2-4432-9682-4fb106383299 tempest-AttachVolumeTestJSON-2043566449 None] Lock "cinder-2b9d2f56-8742-40d7-8421-fb2664f4d10e-delete_volume" released by "delete_volume" :: held 0.896s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:10:52.152461 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=41,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:10:58.044197 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-f1df2e75-c929-42cd-9449-a98bf91b4b7d tempest-TaggedBootDevicesTest-1568770669 None] Terminate volume connection completed successfully.
Oct 08 21:10:58.044917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-f1df2e75-c929-42cd-9449-a98bf91b4b7d tempest-TaggedBootDevicesTest-1568770669 None] Deleting attachment c8dc52a0-a9d1-41d2-83d4-9fab020e73dc. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:58.365235 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-87c8cb7f-b4ac-4943-a31a-61442516089a tempest-TaggedBootDevicesTest-1568770669 None] Terminate volume connection completed successfully.
Oct 08 21:10:58.375937 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-87c8cb7f-b4ac-4943-a31a-61442516089a tempest-TaggedBootDevicesTest-1568770669 None] Deleting attachment 1a8f5b17-670f-40e4-b09e-1988fab3c7ab. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:58.631118 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-7f6f79c0-8407-4654-866c-a5f07b35ae51 tempest-TaggedBootDevicesTest-1568770669 None] Terminate volume connection completed successfully.
Oct 08 21:10:58.634024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-7d1a520d-3858-4961-949e-7eff0a578abd req-7f6f79c0-8407-4654-866c-a5f07b35ae51 tempest-TaggedBootDevicesTest-1568770669 None] Deleting attachment 4f4a5811-1c29-4ee8-9a64-70311df29ea4. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:10:59.329551 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:10:59.408839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Flow 'volume_create_manager' (4be8b431-c0cf-4e5a-8961-fefa606180ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:10:59.429174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0a8fe8-1d57-478b-85e2-7809cf7d387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.507866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0a8fe8-1d57-478b-85e2-7809cf7d387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-202033031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4d2f355-6afc-4651-bc07-038d2a3a157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56b9280162d4a6b9bac0cc641147a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:10:59Z,use_quota=True,user_id='7b0248890c8c4da9a1c3d08bcd5742ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.524837 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592caf0b-3d9d-4c17-b5f0-dc9d1d49a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.542716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592caf0b-3d9d-4c17-b5f0-dc9d1d49a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.559061 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fa2e72-60d7-4378-ba80-208d25ca4bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.572077 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fa2e72-60d7-4378-ba80-208d25ca4bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d2f355-6afc-4651-bc07-038d2a3a157c', 'volume_name': 'volume-e4d2f355-6afc-4651-bc07-038d2a3a157c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.586650 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cb6610-bfe6-46b4-ac12-7bd5c0f2f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.608911 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cb6610-bfe6-46b4-ac12-7bd5c0f2f801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.618533 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908fe79-770f-4bd6-9cb1-339b0c020d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.620399 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Volume e4d2f355-6afc-4651-bc07-038d2a3a157c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d2f355-6afc-4651-bc07-038d2a3a157c', 'volume_size': 1}
Oct 08 21:10:59.621630 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] creating volume 'volume-e4d2f355-6afc-4651-bc07-038d2a3a157c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:10:59.622768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:10:59.790914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:10:59.791689 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:10:59.795844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908fe79-770f-4bd6-9cb1-339b0c020d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d2f355-6afc-4651-bc07-038d2a3a157c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.804401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b39aa6-487d-4871-a501-cda515a3bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:10:59.820647 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Volume volume-e4d2f355-6afc-4651-bc07-038d2a3a157c (e4d2f355-6afc-4651-bc07-038d2a3a157c): created successfully
Oct 08 21:10:59.825572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b39aa6-487d-4871-a501-cda515a3bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:10:59.833793 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Flow 'volume_create_manager' (4be8b431-c0cf-4e5a-8961-fefa606180ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:10:59.849128 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-c3fe3d42-6649-41bc-aa81-06bdca2b7b46 req-18491a1d-e48e-4aa6-8665-a2e2979beabb tempest-VolumesSnapshotsTestJSON-1481697256 None] Created volume successfully.
Oct 08 21:11:01.270160 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-5ae3f4d8-db8b-497c-8201-8df429f8dbd1 req-042d9704-417d-4a53-af98-b84614c83f91 tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:02.069602 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-5ae3f4d8-db8b-497c-8201-8df429f8dbd1 req-042d9704-417d-4a53-af98-b84614c83f91 tempest-VolumesSnapshotsTestJSON-1481697256 None] Create snapshot completed successfully
Oct 08 21:11:03.852633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Acquiring lock "cinder-8a4a6545-b346-486f-a8c2-9b627f885d5b-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:03.885163 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Lock "cinder-8a4a6545-b346-486f-a8c2-9b627f885d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:03.889119 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:05.106676 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=56,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:05.127323 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:05.183438 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Created reservations ['446fc347-287a-4fc6-8793-e4619f035848', '5f24067e-94bd-47c1-aae3-52797fae7e4e', 'b8eab56d-73fa-4b09-a312-70d7d1e6af60', 'e0ec4171-3e17-46c8-a169-1fddeba23ffc'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:05.252382 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Delete snapshot completed successfully.
Oct 08 21:11:05.264552 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-accef256-1dbf-45aa-b678-333541688bb4 req-3fc42735-8f7a-4cb7-ac93-443f593f153e tempest-VolumesSnapshotsTestJSON-1481697256 None] Lock "cinder-8a4a6545-b346-486f-a8c2-9b627f885d5b-delete_snapshot" released by "delete_snapshot" :: held 1.379s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:05.328685 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8688cb2e-0443-49e5-836f-9b115447b99c tempest-GroupSnapshotsV319Test-1284488885 None] Group tempest-GroupSnapshotsV319Test-Group-1419361789: creating
Oct 08 21:11:05.376310 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8688cb2e-0443-49e5-836f-9b115447b99c tempest-GroupSnapshotsV319Test-1284488885 None] Group tempest-GroupSnapshotsV319Test-Group-1419361789: created successfully
Oct 08 21:11:05.402626 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8688cb2e-0443-49e5-836f-9b115447b99c tempest-GroupSnapshotsV319Test-1284488885 None] Create group completed successfully.
Oct 08 21:11:05.952048 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:11:05.953049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:06.049873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:06.139381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:06.582393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Acquiring lock "cinder-e4d2f355-6afc-4651-bc07-038d2a3a157c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:06.643342 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Lock "cinder-e4d2f355-6afc-4651-bc07-038d2a3a157c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:06.761060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:06.872747 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:06.873176 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Volume volume-e4d2f355-6afc-4651-bc07-038d2a3a157c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:06.889794 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] deleting rbd volume volume-e4d2f355-6afc-4651-bc07-038d2a3a157c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:07.358928 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:11:07.381038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Flow 'volume_create_manager' (90451294-16bd-4628-9b20-5994d42e621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:07.388993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1beaf0-de8a-45b1-8adc-9f2d43ae3302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.407857 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1beaf0-de8a-45b1-8adc-9f2d43ae3302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-476744914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8343455e-b6ac-4fd4-affd-c2d838c916d3,host='ncdv-master-1@ceph#ceph',id=5c550ad7-333d-4687-ae86-ba65fafecd99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdd27e001dc45d3b92a2db3577e2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:11:07Z,use_quota=True,user_id='63753501c8674e169cfde7c2457abf73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ff8b455-5277-4232-8b49-add4d9e404ba),volume_type_id=4ff8b455-5277-4232-8b49-add4d9e404ba)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.413722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dd89bf-9210-47d1-abe8-a95b14760f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.418094 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dd89bf-9210-47d1-abe8-a95b14760f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.424070 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19771150-6bd9-4d65-ad2a-7a38d892734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.430334 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19771150-6bd9-4d65-ad2a-7a38d892734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c550ad7-333d-4687-ae86-ba65fafecd99', 'volume_name': 'volume-5c550ad7-333d-4687-ae86-ba65fafecd99', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.435863 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f8c318-2e8c-47e6-937b-9a1f4c33a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.440297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f8c318-2e8c-47e6-937b-9a1f4c33a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.446019 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113fc4b3-9153-41f6-b790-73a82e1c3818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.447381 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Volume 5c550ad7-333d-4687-ae86-ba65fafecd99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c550ad7-333d-4687-ae86-ba65fafecd99', 'volume_size': 1}
Oct 08 21:11:07.448043 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] creating volume 'volume-5c550ad7-333d-4687-ae86-ba65fafecd99' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:11:07.449257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:07.511828 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Created reservations ['e52cabf1-8d7d-495d-ab62-7b98a09ddaa5', '62651acc-2038-4b3d-b778-c277c7e20be5', '6f09f49a-7b2a-4646-966d-92f0369d62d0', 'ae5f72e7-4be8-4521-a8f5-21a33365550c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:07.564258 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:11:07.564635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:11:07.583604 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113fc4b3-9153-41f6-b790-73a82e1c3818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c550ad7-333d-4687-ae86-ba65fafecd99', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.588445 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92d41a9-1125-4613-9eee-18a41a89b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:07.607578 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Volume volume-5c550ad7-333d-4687-ae86-ba65fafecd99 (5c550ad7-333d-4687-ae86-ba65fafecd99): created successfully
Oct 08 21:11:07.611296 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92d41a9-1125-4613-9eee-18a41a89b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:07.617341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Flow 'volume_create_manager' (90451294-16bd-4628-9b20-5994d42e621e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:07.633693 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-20aa6ddd-fb36-4f00-8007-7c6b61e257a3 tempest-GroupSnapshotsV319Test-1284488885 None] Created volume successfully.
Oct 08 21:11:07.638914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:07.716294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:07.776214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:07.782014 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Deleted volume successfully.
Oct 08 21:11:07.799608 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-6ba55b22-c45c-495e-ab18-d92a11b11b08 req-be675226-6d56-40a2-b1e8-0e5bedc8d876 tempest-VolumesSnapshotsTestJSON-1481697256 None] Lock "cinder-e4d2f355-6afc-4651-bc07-038d2a3a157c-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:08.061529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Acquiring lock "cinder-1082d721-8d03-4d1a-a930-7e3c44810f2d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:08.079734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-1082d721-8d03-4d1a-a930-7e3c44810f2d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:08.154111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:08.285868 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:08.286286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-1082d721-8d03-4d1a-a930-7e3c44810f2d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:08.300658 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] deleting rbd volume volume-1082d721-8d03-4d1a-a930-7e3c44810f2d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:08.762029 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Created reservations ['48639768-c28a-45df-8094-8c9962a1e2e9', 'c911d3fc-d2db-462d-9405-fbb1f631eedd', '66d1367b-1ae8-490e-b41e-9b7fc00fdf3e', 'e8e734b3-0a0e-4160-a506-50fca352686f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:08.842786 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:08.862916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:08.953384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:09.022648 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:09.036000 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Deleted volume successfully.
Oct 08 21:11:09.069424 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5bd2623d-9168-4942-bfc4-5e142f1c827a tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-1082d721-8d03-4d1a-a930-7e3c44810f2d-delete_volume" released by "delete_volume" :: held 0.988s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:09.088022 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-72b121f1-dd54-46bd-947e-45483454a417 tempest-GroupSnapshotsV319Test-1284488885 None] GroupSnapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: creating.
Oct 08 21:11:09.147417 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-72b121f1-dd54-46bd-947e-45483454a417 tempest-GroupSnapshotsV319Test-1284488885 None] Group snapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: creating. {{(pid=133344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 08 21:11:09.177351 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-72b121f1-dd54-46bd-947e-45483454a417 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:09.370789 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Acquiring lock "cinder-a86c82f7-9354-427c-b8fd-facabded1ea9-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:09.388076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-a86c82f7-9354-427c-b8fd-facabded1ea9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:09.524683 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:09.659473 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:09.660031 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Volume volume-a86c82f7-9354-427c-b8fd-facabded1ea9 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:09.671439 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] deleting rbd volume volume-a86c82f7-9354-427c-b8fd-facabded1ea9 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:10.108134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Created reservations ['831b37c5-e168-4f50-adfd-6314e22f3442', '674062d9-3901-4a7a-bacf-78d28acc6cf8', '89604770-2a45-4968-9bc7-c1f84f3c5d6e', 'a05ba19f-7cd8-4615-b119-e844ad18b564'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:10.291121 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:10.397313 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:10.461738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:10.484232 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:10.493427 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-72b121f1-dd54-46bd-947e-45483454a417 tempest-GroupSnapshotsV319Test-1284488885 None] group_snapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: created successfully
Oct 08 21:11:10.512991 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Deleted volume successfully.
Oct 08 21:11:10.530545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5357c7e-ecb0-4454-a850-0776a5ba2e3e tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-a86c82f7-9354-427c-b8fd-facabded1ea9-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:10.644571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Acquiring lock "cinder-d9c63c96-d67e-46bf-97d4-00d738c11e05-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:10.656749 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-d9c63c96-d67e-46bf-97d4-00d738c11e05-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:10.796305 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:10.943033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:10.959903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] deleting rbd volume volume-d9c63c96-d67e-46bf-97d4-00d738c11e05 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:11.474606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:11:11.517078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] deleting parent snapshot volume-d9c63c96-d67e-46bf-97d4-00d738c11e05.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:11:12.273767 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] group_snapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: deleting
Oct 08 21:11:12.351616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] group_snapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: deleting {{(pid=133344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 08 21:11:12.392999 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:12.482095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Created reservations ['5d629588-4655-4ebd-8299-1ef390b6d16a', '7f10d719-50a4-4791-90a2-1386540fb9fc', '85bdb30c-bcdf-45e9-86f1-a280bf6284b6', '70034cfc-87f8-409e-ac50-c234b8b7a94c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:12.611483 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:12.664893 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:12.734752 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:12.741342 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Deleted volume successfully.
Oct 08 21:11:12.767672 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1afe6e41-b079-4a17-8132-3c1b12daebd9 tempest-TaggedBootDevicesTest-1568770669 None] Lock "cinder-d9c63c96-d67e-46bf-97d4-00d738c11e05-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:13.523049 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-683308706 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-683308706, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:13.523862 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-683308706 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-683308706, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:13.582695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] Created reservations ['78f9aba7-058d-4420-b47b-ce15802e8bb4', 'a9225fb2-0944-45a3-b84c-49b216f7a1c8', '9aa85046-90f0-4bb6-b484-e9d07f751da0', '99356224-af74-4c9a-960c-26e77d2ad277'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:13.731117 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-070b5b48-aceb-4b6f-b72e-ebf74c1aef36 tempest-GroupSnapshotsV319Test-1284488885 None] group_snapshot 4094b0b7-96b3-477d-8516-8a14a311b3af: deleted successfully
Oct 08 21:11:15.336703 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:15.445976 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:15.446508 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Volume volume-5c550ad7-333d-4687-ae86-ba65fafecd99 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:15.462833 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] deleting rbd volume volume-5c550ad7-333d-4687-ae86-ba65fafecd99 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:16.023066 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Created reservations ['3fb820c2-1366-4772-9e57-4ef970361768'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:16.045462 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-683308706 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-683308706, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:16.073150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Created reservations ['c7e94cb5-6921-43c5-8d2b-be4d935eeed3', 'bc5f6753-75d2-4d1b-97f8-f4c485e3895b', '6b1cb6ad-ba59-4082-8b6b-0d8c98514425', 'cd59264d-5594-40a7-8ded-584c5a73c806'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:16.119860 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:16.230159 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:16.298273 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:16.363209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:16.369364 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ce19d020-3b43-4675-942a-2e5873b52ea0 tempest-GroupSnapshotsV319Test-1284488885 None] Delete group completed successfully.
Oct 08 21:11:25.722893 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-20872e98-4571-4315-b2f3-8e1d019b5b65 tempest-GroupsTest-1922848238 None] Group tempest-Group1-1524609879: creating
Oct 08 21:11:25.757415 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-20872e98-4571-4315-b2f3-8e1d019b5b65 tempest-GroupsTest-1922848238 None] Group tempest-Group1-1524609879: created successfully
Oct 08 21:11:25.775612 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-20872e98-4571-4315-b2f3-8e1d019b5b65 tempest-GroupsTest-1922848238 None] Create group completed successfully.
Oct 08 21:11:27.091778 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:27.095027 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3af16e1a-79aa-4133-b582-06fbdcf4c0dd tempest-GroupsTest-1922848238 None] Group tempest-Group2-1947095060: creating
Oct 08 21:11:27.171045 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3af16e1a-79aa-4133-b582-06fbdcf4c0dd tempest-GroupsTest-1922848238 None] Group tempest-Group2-1947095060: created successfully
Oct 08 21:11:27.190589 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3af16e1a-79aa-4133-b582-06fbdcf4c0dd tempest-GroupsTest-1922848238 None] Create group completed successfully.
Oct 08 21:11:29.025957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:11:29.110657 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (22da5e12-7889-4f4a-ac85-b433184dc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:29.137553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c39613-58a9-4095-9ccd-16291107aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.173341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c39613-58a9-4095-9ccd-16291107aaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124320959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fca2a500-eb2a-4d2a-a0a3-ece2c18fe248,host='ncdv-master-1@ceph#ceph',id=810f6a85-35eb-451a-8737-ab62ad4060f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26c456dde0d4002aeceb99e210970fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:11:29Z,use_quota=True,user_id='edb2b7e770c540d092b0e06096ddbd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cee4ff28-84ac-496e-8a43-f9980a13a41c),volume_type_id=cee4ff28-84ac-496e-8a43-f9980a13a41c)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.189950 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc27ffa-6436-46a8-ac99-8b365dce56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.197464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc27ffa-6436-46a8-ac99-8b365dce56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.203060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d1a3c-5946-4741-bd0f-2b83dfd3aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.208527 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d1a3c-5946-4741-bd0f-2b83dfd3aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810f6a85-35eb-451a-8737-ab62ad4060f2', 'volume_name': 'volume-810f6a85-35eb-451a-8737-ab62ad4060f2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.214114 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6307a77b-7427-4864-9b3b-22e5ec177e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.218847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6307a77b-7427-4864-9b3b-22e5ec177e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.225124 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10676ca4-7b6f-4ec1-9018-0fab2b554c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.226573 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Volume 810f6a85-35eb-451a-8737-ab62ad4060f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810f6a85-35eb-451a-8737-ab62ad4060f2', 'volume_size': 1}
Oct 08 21:11:29.227282 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] creating volume 'volume-810f6a85-35eb-451a-8737-ab62ad4060f2' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:11:29.228346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:29.343245 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:11:29.343956 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:11:29.349147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10676ca4-7b6f-4ec1-9018-0fab2b554c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810f6a85-35eb-451a-8737-ab62ad4060f2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.356583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9552a8-2393-4a6b-b7d0-f5eca68c3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:29.376456 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Volume volume-810f6a85-35eb-451a-8737-ab62ad4060f2 (810f6a85-35eb-451a-8737-ab62ad4060f2): created successfully
Oct 08 21:11:29.387054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9552a8-2393-4a6b-b7d0-f5eca68c3776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:29.403964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (22da5e12-7889-4f4a-ac85-b433184dc3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:29.430858 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3a231988-a71e-4cc9-b7d9-891d2b182e9e tempest-GroupsTest-1922848238 None] Created volume successfully.
Oct 08 21:11:31.144909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:31.278099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:31.278787 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Volume volume-810f6a85-35eb-451a-8737-ab62ad4060f2 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:31.289935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] deleting rbd volume volume-810f6a85-35eb-451a-8737-ab62ad4060f2 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:31.706240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Created reservations ['f60d81d1-dcc7-4645-8a61-b4c542208318'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:31.764337 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2124462234 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2124462234, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:31.765123 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2124462234 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2124462234, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:31.818740 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Created reservations ['1047b61a-c300-462e-a95c-9bdd98547c1e', '46252e31-3b36-446a-a0e1-dadf9e9ffead', '646ca99f-d441-4457-8d36-0068772c2a7c', 'aa0df7c3-aa9e-410f-a21c-d166bf5f5529'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:32.006909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:32.082364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:32.177001 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:32.183333 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-026e372a-0cc8-43fd-af98-d1374039ad65 tempest-GroupsTest-1922848238 None] Delete group completed successfully.
Oct 08 21:11:32.778236 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-eda49e35-d7c5-40d2-9701-cd992fae1118 tempest-GroupsTest-1922848238 None] Created reservations ['f4c430de-64a5-4cbd-97ac-3e92bfaadbc2'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:32.864798 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eda49e35-d7c5-40d2-9701-cd992fae1118 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:32.953662 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eda49e35-d7c5-40d2-9701-cd992fae1118 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:33.029218 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-eda49e35-d7c5-40d2-9701-cd992fae1118 tempest-GroupsTest-1922848238 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:33.047169 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eda49e35-d7c5-40d2-9701-cd992fae1118 tempest-GroupsTest-1922848238 None] Delete group completed successfully.
Oct 08 21:11:35.116854 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53399d48-28c4-4e39-8a48-b42f2c10e869 tempest-GroupsTest-1922848238 None] Group tempest-GroupsTest-Group-232485489: creating
Oct 08 21:11:35.159724 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53399d48-28c4-4e39-8a48-b42f2c10e869 tempest-GroupsTest-1922848238 None] Group tempest-GroupsTest-Group-232485489: created successfully
Oct 08 21:11:35.198525 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53399d48-28c4-4e39-8a48-b42f2c10e869 tempest-GroupsTest-1922848238 None] Create group completed successfully.
Oct 08 21:11:37.286538 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:11:37.344173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (f0d3069c-949e-4f3f-b464-0771ccd2b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:37.351639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c6405-1939-42e5-a6fc-ed3771d98bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.399646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c6405-1939-42e5-a6fc-ed3771d98bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-95035052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0ee8ae7a-6132-4976-8f3f-28704aff4959,host='ncdv-master-1@ceph#ceph',id=a58332f4-dcc0-40f7-ad3e-66320c7647c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26c456dde0d4002aeceb99e210970fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:11:37Z,use_quota=True,user_id='edb2b7e770c540d092b0e06096ddbd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56ddac2d-95d4-42f0-a079-6ed51f6900d6),volume_type_id=56ddac2d-95d4-42f0-a079-6ed51f6900d6)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.414074 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c6fc34-6773-454e-a132-3c3c7668d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.429555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c6fc34-6773-454e-a132-3c3c7668d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.435603 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2968ce90-6a60-410d-997f-0edccc8438f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.440228 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2968ce90-6a60-410d-997f-0edccc8438f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58332f4-dcc0-40f7-ad3e-66320c7647c8', 'volume_name': 'volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.458503 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0b00b5-71b1-4f01-8616-8e86f1265558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.462673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0b00b5-71b1-4f01-8616-8e86f1265558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.467487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84018ce-24b0-49f4-b5de-a0d02647ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.468675 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Volume a58332f4-dcc0-40f7-ad3e-66320c7647c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8', 'volume_size': 1}
Oct 08 21:11:37.469096 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] creating volume 'volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:11:37.482289 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:37.610946 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:11:37.611287 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:11:37.618179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84018ce-24b0-49f4-b5de-a0d02647ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.624738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daab2e7-0acc-4d3b-9e14-8a81fffe3463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:37.651189 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Volume volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8 (a58332f4-dcc0-40f7-ad3e-66320c7647c8): created successfully
Oct 08 21:11:37.661623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9daab2e7-0acc-4d3b-9e14-8a81fffe3463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:37.670876 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (f0d3069c-949e-4f3f-b464-0771ccd2b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:37.685489 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-747a5781-aa02-4c37-b8de-b7daf10f5273 tempest-GroupsTest-1922848238 None] Created volume successfully.
Oct 08 21:11:39.220532 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:11:39.291019 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (52f29890-2989-4f60-ae1a-8a9d19b08acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:39.314871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aeb5d8-0099-437d-839a-5c01f05b6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.359672 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aeb5d8-0099-437d-839a-5c01f05b6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1571348737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0ee8ae7a-6132-4976-8f3f-28704aff4959,host='ncdv-master-1@ceph#ceph',id=0275ad76-650b-4b14-9915-90b25532c83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26c456dde0d4002aeceb99e210970fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:11:39Z,use_quota=True,user_id='edb2b7e770c540d092b0e06096ddbd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56ddac2d-95d4-42f0-a079-6ed51f6900d6),volume_type_id=56ddac2d-95d4-42f0-a079-6ed51f6900d6)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.378981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28919554-0381-4197-81c4-d2a965016501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.384917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28919554-0381-4197-81c4-d2a965016501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.392981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd99f6b-e099-4947-b9f3-df8b7fb3c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.398580 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd99f6b-e099-4947-b9f3-df8b7fb3c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0275ad76-650b-4b14-9915-90b25532c83e', 'volume_name': 'volume-0275ad76-650b-4b14-9915-90b25532c83e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.406721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1b09a7-f606-4b50-a47c-392c99271df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.413090 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1b09a7-f606-4b50-a47c-392c99271df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.421525 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93653a6d-e815-4cb2-a076-ead6692ea531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.423298 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Volume 0275ad76-650b-4b14-9915-90b25532c83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0275ad76-650b-4b14-9915-90b25532c83e', 'volume_size': 1}
Oct 08 21:11:39.423923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] creating volume 'volume-0275ad76-650b-4b14-9915-90b25532c83e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:11:39.424805 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:39.530121 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Acquiring lock "cinder-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:39.546788 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Lock "cinder-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:39.596125 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:11:39.596938 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:11:39.603599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93653a6d-e815-4cb2-a076-ead6692ea531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0275ad76-650b-4b14-9915-90b25532c83e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.658408 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2743d2-05b2-4bef-ad93-0de1ed1fc58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:11:39.711920 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Volume volume-0275ad76-650b-4b14-9915-90b25532c83e (0275ad76-650b-4b14-9915-90b25532c83e): created successfully
Oct 08 21:11:39.715484 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2743d2-05b2-4bef-ad93-0de1ed1fc58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:11:39.758089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Flow 'volume_create_manager' (52f29890-2989-4f60-ae1a-8a9d19b08acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:11:39.805599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:39.902921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:39.904015 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:39.910185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] deleting rbd volume volume-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:39.917955 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3296c9a4-5525-4a9e-bccf-2b2e25004ddd tempest-GroupsTest-1922848238 None] Created volume successfully.
Oct 08 21:11:40.273586 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Created reservations ['77e36146-e1ea-4539-bde0-7ca2f5287c2e', 'c1838a65-96bd-46e2-bfda-6ad2f62b6359', '2d39d669-24d7-414e-a67a-fa14ff0107f5', '78da668f-54c2-4ea5-98c4-57bf9b4b2d6b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:40.307762 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=28,cinder:SELECT=67,cinder:INSERT=4,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:40.491584 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:40.603510 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:40.728521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:40.838592 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Deleted volume successfully.
Oct 08 21:11:40.923707 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4144df6b-e0b0-4dfb-a8cf-b98d48aab9ee tempest-AttachVolumeShelveTestJSON-1179861839 None] Lock "cinder-f4c6e466-2adb-4dc5-88bc-47c1969a8c8d-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:41.008573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Acquiring lock "cinder-31e209f5-1092-4499-a719-01507df30223-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:11:41.035879 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f98dac87-ae19-43af-9d70-075fab7cca55 tempest-GroupsTest-1922848238 None] Update group completed successfully.
Oct 08 21:11:41.069060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Lock "cinder-31e209f5-1092-4499-a719-01507df30223-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:11:41.166436 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=64,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:11:41.217913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:41.352696 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:41.353363 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Volume volume-31e209f5-1092-4499-a719-01507df30223 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:41.359362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] deleting rbd volume volume-31e209f5-1092-4499-a719-01507df30223 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:41.800128 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Created reservations ['b370637f-4bd5-4d77-82e4-869deb3f291a', '34a3f1e7-ee76-47e3-9cda-744411867900', '0ca4f3b3-d3f8-4301-9758-2a025bc6c37d', '97d51c78-4915-4545-835e-3456a40eaeb3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:41.951804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:42.049644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:42.141823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:42.154872 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Deleted volume successfully.
Oct 08 21:11:42.184374 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9b7237a7-72f1-4560-8f61-bff39645402e tempest-AttachVolumeShelveTestJSON-1179861839 None] Lock "cinder-31e209f5-1092-4499-a719-01507df30223-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:11:42.517155 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c175d085-09bf-4175-846a-5c07d12dd5d3 tempest-GroupsTest-1922848238 None] Update group completed successfully.
Oct 08 21:11:44.772632 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:44.885815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:44.886657 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Volume volume-0275ad76-650b-4b14-9915-90b25532c83e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:44.908966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] deleting rbd volume volume-0275ad76-650b-4b14-9915-90b25532c83e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:45.282637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:45.400277 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:11:45.402420 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Volume volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:11:45.415665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] deleting rbd volume volume-a58332f4-dcc0-40f7-ad3e-66320c7647c8 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:11:45.875384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Created reservations ['2c28fb46-1740-4a8c-a857-a5e65ade2acb'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:45.976868 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2054940763 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2054940763, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:45.979671 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2054940763 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2054940763, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:11:46.027849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Created reservations ['949e73cb-101c-42f2-968b-3da7f4fa169f', 'c9d933cb-01fa-4729-8e0d-7696ea0d6266', '0ce8d0db-7c99-4cf1-83a9-93fb1e45456e', '7b604f3e-4a47-4258-b747-ba2135a6f100'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:46.285386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Created reservations ['d6fe1bc5-1fd7-41b0-8df1-223332ed20f4', '2d00db78-a37a-4573-8c98-d30c91c6a53b', '60da0893-c3db-40e2-b352-c1d6544652e6', '0b12b692-79c9-48e2-a939-14a16c0683ef'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:11:46.428628 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:46.495563 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:11:46.560423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:11:46.565246 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-edb02387-8ed2-4cd9-9feb-9c688ec2cd5d tempest-GroupsTest-1922848238 None] Delete group completed successfully.
Oct 08 21:11:56.424484 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=53,cinder:UPDATE=30,cinder:INSERT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:12:02.293649 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=48,cinder:INSERT=5,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:12:05.949303 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:12:05.950099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:06.042933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:06.129801 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:12:11.832806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:12:11.858497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Flow 'volume_create_manager' (aa6f169a-304e-4850-9314-6d1c4b1d0cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:12:11.866601 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d43a8f-a511-4cd9-aea9-28d3b110a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:11.886510 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d43a8f-a511-4cd9-aea9-28d3b110a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1335925304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=133ac51d-7495-4637-8474-d823f7626227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e7663e704b4ca4b7a47b6f9b3113e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:12:12Z,use_quota=True,user_id='84860f5a6aa2438dade943bb1190c678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4489aa90-2712-48e0-80d5-c8272642b4a9),volume_type_id=4489aa90-2712-48e0-80d5-c8272642b4a9)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:11.892632 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcba1a0c-15ec-49e6-b4d4-01d0e76ad670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:11.897734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcba1a0c-15ec-49e6-b4d4-01d0e76ad670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:11.902775 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a508b62-a503-43b0-b26d-9863fb61c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:11.909115 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a508b62-a503-43b0-b26d-9863fb61c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133ac51d-7495-4637-8474-d823f7626227', 'volume_name': 'volume-133ac51d-7495-4637-8474-d823f7626227', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:11.915081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde79d03-89f1-4f13-976b-d320da936f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:11.921008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde79d03-89f1-4f13-976b-d320da936f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:11.925841 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd9c166-b514-4064-ada5-20ac34cc8298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:11.927177 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Volume 133ac51d-7495-4637-8474-d823f7626227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133ac51d-7495-4637-8474-d823f7626227', 'volume_size': 1}
Oct 08 21:12:11.927751 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] creating volume 'volume-133ac51d-7495-4637-8474-d823f7626227' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:12:11.928727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:12.034596 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:12:12.035195 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:12:12.039977 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd9c166-b514-4064-ada5-20ac34cc8298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133ac51d-7495-4637-8474-d823f7626227', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:12.046341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc35e0cb-f15e-4e64-b1e7-e1e6b2a258af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:12.060289 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Volume volume-133ac51d-7495-4637-8474-d823f7626227 (133ac51d-7495-4637-8474-d823f7626227): created successfully
Oct 08 21:12:12.065742 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc35e0cb-f15e-4e64-b1e7-e1e6b2a258af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:12.073821 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Flow 'volume_create_manager' (aa6f169a-304e-4850-9314-6d1c4b1d0cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:12:12.085019 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-237ba47d-7dd2-43db-b583-cb00b12b81f0 tempest-VolumeTypesAccessTest-855956280 None] Created volume successfully.
Oct 08 21:12:13.431710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Acquiring lock "cinder-133ac51d-7495-4637-8474-d823f7626227-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:13.447249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Lock "cinder-133ac51d-7495-4637-8474-d823f7626227-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:13.524381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:13.622821 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:12:13.623918 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Volume volume-133ac51d-7495-4637-8474-d823f7626227 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:12:13.635798 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] deleting rbd volume volume-133ac51d-7495-4637-8474-d823f7626227 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:12:13.899325 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-736101520 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-736101520, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:12:13.900738 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-736101520 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-736101520, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:12:13.934472 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Created reservations ['bf8e30f8-7931-4974-9301-0a86eda20bb5', 'f9dde72e-da96-470e-8213-e323617348c1', '79aa4dba-d24a-402f-93c8-d6a035c37764', '101e5ef2-945b-4862-b054-10526ea6e200'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:12:14.009751 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:14.095415 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:14.170732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:12:14.180372 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Deleted volume successfully.
Oct 08 21:12:14.204149 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-400844a6-1313-487a-9fff-65e18eb14394 tempest-VolumeTypesAccessTest-855956280 None] Lock "cinder-133ac51d-7495-4637-8474-d823f7626227-delete_volume" released by "delete_volume" :: held 0.757s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:12:18.980855 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Acquiring lock "cinder-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:19.032388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Lock "cinder-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:19.142625 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:19.251818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:12:19.252654 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Volume volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:12:19.266721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] deleting rbd volume volume-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:12:19.272166 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Acquiring lock "cinder-d22df1a4-c142-4980-a855-4b5f1733fd4d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:19.289874 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Lock "cinder-d22df1a4-c142-4980-a855-4b5f1733fd4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:19.385878 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:19.521836 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:12:19.522375 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Volume volume-d22df1a4-c142-4980-a855-4b5f1733fd4d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:12:19.531389 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] deleting rbd volume volume-d22df1a4-c142-4980-a855-4b5f1733fd4d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:12:19.746554 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Created reservations ['53808244-3b55-431e-a291-7039269929b0', 'ae3f7f28-a995-4ec3-a3d5-43aa9874ea72', '60c8cc5f-c064-4a00-8ac3-a061c922e032', '5843fb5b-84f6-4ee3-8d67-c3734d54a756'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:12:19.854385 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:19.962466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:20.068746 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:12:20.085770 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Deleted volume successfully.
Oct 08 21:12:20.184777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-930dbe1e-6468-4bbf-9ffb-d131f6959c4a tempest-ServersNegativeTestJSON-1441071354 None] Lock "cinder-0e7dcb6a-067d-4bd6-99c7-b38b6877dca2-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:12:20.237382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Created reservations ['927e4f40-6fb9-483e-b32b-7589d7818569', '258822bf-e86c-4296-9bc6-5d8ad6774143', 'df7e3523-1e7c-42ad-983f-4ed5849cdc84', '30d2df13-72fb-4512-b1a1-28f485e1696b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:12:20.385594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Acquiring lock "cinder-dba60c3d-e3db-4e3c-be55-9d95fad53c72-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:20.403898 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:20.553448 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Lock "cinder-dba60c3d-e3db-4e3c-be55-9d95fad53c72-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:20.560791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:20.640771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:12:20.658337 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Deleted volume successfully.
Oct 08 21:12:20.727403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:20.810767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:12:20.811373 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Volume volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:12:20.837781 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] deleting rbd volume volume-dba60c3d-e3db-4e3c-be55-9d95fad53c72 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:12:20.839603 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bdaf4f9b-adab-41f1-9c5c-ae92b2563870 tempest-DeleteServersTestJSON-1423663413 None] Lock "cinder-d22df1a4-c142-4980-a855-4b5f1733fd4d-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:12:21.277465 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Created reservations ['2c87fde0-609f-4389-9277-dd499f45621b', 'ff2621a9-77fb-449e-82b3-eb87a76e7175', 'c15fe6d4-2f6d-40ea-87c6-e644e32e3309', '73be9952-c27d-4fda-97d1-e0d34c61d09c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:12:21.328286 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:12:21.380727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:21.481132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:21.547777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:12:21.554620 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Deleted volume successfully.
Oct 08 21:12:21.573753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7adb7049-c09d-46d3-a38c-e242361dbe08 tempest-ServersNegativeTestJSON-1441071354 None] Lock "cinder-dba60c3d-e3db-4e3c-be55-9d95fad53c72-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:12:22.280620 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=51,cinder:UPDATE=38,cinder:DELETE=1,cinder:INSERT=10 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:12:52.275757 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:DELETE=1,cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:12:56.871434 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:12:56.912968 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (d9cc99f6-a77d-4fee-83de-86bea0f52aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:12:56.920404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3807d0d-8dbf-4c07-8058-21a1154c7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:56.937933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3807d0d-8dbf-4c07-8058-21a1154c7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1413984331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=65a73b75-1e20-49b0-a945-c7bc0e89c9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:12:57Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:56.945621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4325f29-b680-4297-a9c5-6a8b164f29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:56.951403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4325f29-b680-4297-a9c5-6a8b164f29d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:56.959577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf8c883-9fcb-41da-a918-7232ba2eec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:56.981332 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf8c883-9fcb-41da-a918-7232ba2eec6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a73b75-1e20-49b0-a945-c7bc0e89c9c7', 'volume_name': 'volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:56.995779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec63a25-8c29-45a4-a551-42669bac5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:57.012098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec63a25-8c29-45a4-a551-42669bac5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:57.021830 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff7ad67-8acd-420e-8d43-9b932466b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:57.028461 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Volume 65a73b75-1e20-49b0-a945-c7bc0e89c9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7', 'volume_size': 1}
Oct 08 21:12:57.029076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:12:57.031490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:12:57.184974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:12:57.185375 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:12:57.189098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff7ad67-8acd-420e-8d43-9b932466b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:57.196369 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787df0d-5db3-4e27-b982-b4dd5a3ca6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:12:57.224383 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Volume volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7 (65a73b75-1e20-49b0-a945-c7bc0e89c9c7): created successfully
Oct 08 21:12:57.230038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787df0d-5db3-4e27-b982-b4dd5a3ca6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:12:57.241038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (d9cc99f6-a77d-4fee-83de-86bea0f52aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:12:57.272611 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-48f1ac74-1f81-4f4d-9bc1-0d16be745de6 tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:12:58.036943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c7574c5e-971b-42d6-84ce-4027f8f60027 tempest-VolumesActionsTest-1575257702 None] Acquiring lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7" by "attach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:58.058349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c7574c5e-971b-42d6-84ce-4027f8f60027 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7" acquired by "attach_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:58.187256 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c7574c5e-971b-42d6-84ce-4027f8f60027 tempest-VolumesActionsTest-1575257702 None] Attaching volume 65a73b75-1e20-49b0-a945-c7bc0e89c9c7 to instance 8529883c-3fdd-4af4-b295-c17e6c149072 at mountpoint /dev/sdb on host None.
Oct 08 21:12:58.256229 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c7574c5e-971b-42d6-84ce-4027f8f60027 tempest-VolumesActionsTest-1575257702 None] Attach volume completed successfully.
Oct 08 21:12:58.264387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c7574c5e-971b-42d6-84ce-4027f8f60027 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7" released by "attach_volume" :: held 0.210s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:12:59.519646 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Terminate volume connection completed successfully.
Oct 08 21:12:59.551406 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Acquiring lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" by "detach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:12:59.583571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:12:59.633694 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Detaching volume 65a73b75-1e20-49b0-a945-c7bc0e89c9c7 from instance 8529883c-3fdd-4af4-b295-c17e6c149072.
Oct 08 21:12:59.743080 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Detach volume completed successfully.
Oct 08 21:12:59.750096 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c2c2fe88-028b-4a36-bcf4-c7ffa177e7d9 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:00.133858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6a848211-db59-44a9-91a5-9bb378bdf4b3 tempest-VolumesActionsTest-1575257702 None] Acquiring lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" by "detach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:00.152757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6a848211-db59-44a9-91a5-9bb378bdf4b3 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:00.154225 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6a848211-db59-44a9-91a5-9bb378bdf4b3 tempest-VolumesActionsTest-1575257702 None] Volume detach called, but volume not attached.
Oct 08 21:13:00.192215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6a848211-db59-44a9-91a5-9bb378bdf4b3 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:05.949426 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:13:05.950114 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:06.018655 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:06.107890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:07.025454 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:13:07.064778 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:07.116333 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (3aaec474-4874-402f-bc28-14cd16fbfb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:07.131932 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2032a606-dfdc-410a-af47-d71b34cf5bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.186747 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2032a606-dfdc-410a-af47-d71b34cf5bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1440678266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e723ff7-3a48-4e35-8d0a-e7f49c13c051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:07Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.211630 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac6dd4-b06a-47cd-bf4f-d6770258e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.221293 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac6dd4-b06a-47cd-bf4f-d6770258e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.235667 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14197b1-d27d-4b85-b56e-9d5ac940f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.242352 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14197b1-d27d-4b85-b56e-9d5ac940f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e723ff7-3a48-4e35-8d0a-e7f49c13c051', 'volume_name': 'volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.259519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24125e3-2226-44dc-b73b-bc5ef3534f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.263714 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24125e3-2226-44dc-b73b-bc5ef3534f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.281799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1910544-9e29-49c7-b5c1-79121a1ee950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.283076 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Volume 8e723ff7-3a48-4e35-8d0a-e7f49c13c051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051', 'volume_size': 1}
Oct 08 21:13:07.284153 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:07.285525 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:07.449113 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:07.449842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:07.462920 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1910544-9e29-49c7-b5c1-79121a1ee950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.467273 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b35a7a-f134-47ec-91b6-a33e2bbbbc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:07.498974 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Volume volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051 (8e723ff7-3a48-4e35-8d0a-e7f49c13c051): created successfully
Oct 08 21:13:07.514996 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b35a7a-f134-47ec-91b6-a33e2bbbbc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:07.539479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (3aaec474-4874-402f-bc28-14cd16fbfb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:07.579635 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1e7541bb-b7c9-4e2a-9898-a14eb3871e11 tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:13:08.418379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Acquiring lock "cinder-8e723ff7-3a48-4e35-8d0a-e7f49c13c051-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:08.440010 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-8e723ff7-3a48-4e35-8d0a-e7f49c13c051-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:08.494894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:08.618717 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:08.619403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Volume volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:08.632943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] deleting rbd volume volume-8e723ff7-3a48-4e35-8d0a-e7f49c13c051 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:09.097283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Created reservations ['fbf26092-d1c0-4e4e-ad03-4f8c186b07f5', 'fb8fcb5f-c24d-4605-979b-847ad073cf2b', 'a76611a6-15f2-4279-a864-163d4a747e68', 'd8540cbb-c409-4816-a56f-677a8918a095'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:09.214607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:09.312317 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:09.399878 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:09.410603 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Deleted volume successfully.
Oct 08 21:13:09.443134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-10ba5121-1a78-411f-b78d-2f34f6282571 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-8e723ff7-3a48-4e35-8d0a-e7f49c13c051-delete_volume" released by "delete_volume" :: held 1.003s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:10.408598 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:10.469356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (c79ce4d9-42d6-4617-a3a7-8bc2d083de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:10.479635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeb2a7a-27f9-45c6-997c-817980f088f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.572244 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeb2a7a-27f9-45c6-997c-817980f088f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636777376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b4740f9-fc1b-4175-9415-bbf36b0c585b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:10Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.585277 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4708d64e-b4dc-4e42-879f-61876d48dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.591001 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4708d64e-b4dc-4e42-879f-61876d48dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.616985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f14ce-9da1-4a85-9849-2655f660e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.627541 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f14ce-9da1-4a85-9849-2655f660e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4740f9-fc1b-4175-9415-bbf36b0c585b', 'volume_name': 'volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.635320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7d786-cacb-417a-92fb-4636566d2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.640849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7d786-cacb-417a-92fb-4636566d2098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.646732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed76eb-1d44-4013-bd1f-33ce4f5fd947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.648142 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Volume 4b4740f9-fc1b-4175-9415-bbf36b0c585b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b', 'volume_size': 1}
Oct 08 21:13:10.650922 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:10.651921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:10.805607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:10.806584 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:10.815414 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aed76eb-1d44-4013-bd1f-33ce4f5fd947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.839312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3adb0b-368a-4d2c-bae6-ca66171646a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:10.870046 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Volume volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b (4b4740f9-fc1b-4175-9415-bbf36b0c585b): created successfully
Oct 08 21:13:10.877020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3adb0b-368a-4d2c-bae6-ca66171646a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:10.891398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (c79ce4d9-42d6-4617-a3a7-8bc2d083de0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:10.922300 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f2a74f88-00cd-49b5-973c-884f16ea15a3 tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:13:11.787342 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Acquiring lock "cinder-4b4740f9-fc1b-4175-9415-bbf36b0c585b-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:11.804749 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-4b4740f9-fc1b-4175-9415-bbf36b0c585b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:11.854226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:11.961793 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:11.962349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Volume volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:11.971665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] deleting rbd volume volume-4b4740f9-fc1b-4175-9415-bbf36b0c585b {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:12.443238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Created reservations ['6c95773a-6dea-439e-bb7b-4b7d0772c1c1', '3e5089d5-c555-4765-b9a1-36e31bc883ad', 'c851d784-17b0-4c72-b630-bf1558a721cc', 'cc6092a8-c6f9-4dd2-a237-daaa34f5e982'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:12.559608 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:12.667471 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:12.770575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:12.775593 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Deleted volume successfully.
Oct 08 21:13:12.801542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dade3fd-1e74-44ca-8861-2f10590f7430 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-4b4740f9-fc1b-4175-9415-bbf36b0c585b-delete_volume" released by "delete_volume" :: held 0.998s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:13.772854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:13.837374 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (89b48458-6271-4bd4-858f-da5fa273c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:13.866034 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8b258c-b0ec-4761-9988-e3170912c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:13.888603 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8b258c-b0ec-4761-9988-e3170912c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2140812349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:14Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:13.895893 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc233c0e-8075-4aa6-a7a1-56a8378e3e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:13.901545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc233c0e-8075-4aa6-a7a1-56a8378e3e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:13.908150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e22fc3a-a1f3-495d-93e6-7326606e2ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:13.912903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e22fc3a-a1f3-495d-93e6-7326606e2ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f', 'volume_name': 'volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:13.918621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6acda9-623f-4805-9e2b-6d7c86b472ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:13.923769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6acda9-623f-4805-9e2b-6d7c86b472ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:13.929719 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eda7d1-10f8-4111-8be3-9b4bfac90d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:13.931240 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Volume 5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f', 'volume_size': 1}
Oct 08 21:13:13.932343 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:13.933581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:14.056177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:14.057441 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:14.062991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eda7d1-10f8-4111-8be3-9b4bfac90d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:14.069787 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7111c367-7bc7-40cb-91cf-a67b38fe8b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:14.104015 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Volume volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f (5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f): created successfully
Oct 08 21:13:14.109462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7111c367-7bc7-40cb-91cf-a67b38fe8b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:14.116662 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (89b48458-6271-4bd4-858f-da5fa273c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:14.134590 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d4f6d64d-7f0e-4297-8819-43b1312fb081 tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:13:15.111573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Acquiring lock "cinder-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:15.126522 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:15.185304 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:15.272387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:15.273250 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Volume volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:15.280336 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] deleting rbd volume volume-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:15.730020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Created reservations ['3ed3ad9f-b723-492e-bb07-9a5966f7e008', '53b59c0d-a5b7-4be6-8062-0865d3e580f1', '254dc67e-8018-4462-9b11-9bc06fdefbe7', '705d1205-74ed-48d4-8f82-7ab16179e14c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:15.879296 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:15.978148 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:16.048288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:16.052803 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Deleted volume successfully.
Oct 08 21:13:16.075325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-98a43904-f3e5-4016-8294-36ca33cb8706 tempest-VolumesActionsTest-1222918553 None] Lock "cinder-5bb107a6-5d5f-4a74-bd81-8bdf5dfe9b8f-delete_volume" released by "delete_volume" :: held 0.949s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:17.147448 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=69,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:13:17.165000 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:17.263538 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (a74fd8a1-e21a-4ed6-b366-8043892c66b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:17.273504 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34172b92-ffaf-406c-9830-eb9c63d76e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.334772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34172b92-ffaf-406c-9830-eb9c63d76e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723136845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1beafd0-f18c-43f1-aed4-1f373593b494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:17Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.351164 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024f7372-af1f-420b-8118-fc1df99e378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.359731 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024f7372-af1f-420b-8118-fc1df99e378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.376413 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283527a7-ce49-4032-8a9e-874908425a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.389330 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283527a7-ce49-4032-8a9e-874908425a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1beafd0-f18c-43f1-aed4-1f373593b494', 'volume_name': 'volume-a1beafd0-f18c-43f1-aed4-1f373593b494', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.401215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d388-fb80-4d97-9427-867a1c455b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.412178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844d388-fb80-4d97-9427-867a1c455b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.423330 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9673d4b-041c-4f37-bf47-012937ef3e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.426389 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Volume a1beafd0-f18c-43f1-aed4-1f373593b494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1beafd0-f18c-43f1-aed4-1f373593b494', 'volume_size': 1}
Oct 08 21:13:17.427969 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-a1beafd0-f18c-43f1-aed4-1f373593b494' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:17.428758 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:17.576264 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:17.576855 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:17.580739 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9673d4b-041c-4f37-bf47-012937ef3e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1beafd0-f18c-43f1-aed4-1f373593b494', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.586623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b195f87-d1d9-40fd-b64b-ad009bfa1ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:17.603859 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Volume volume-a1beafd0-f18c-43f1-aed4-1f373593b494 (a1beafd0-f18c-43f1-aed4-1f373593b494): created successfully
Oct 08 21:13:17.610549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b195f87-d1d9-40fd-b64b-ad009bfa1ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:17.620760 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (a74fd8a1-e21a-4ed6-b366-8043892c66b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:17.642103 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7b04d08d-ab5d-4046-be08-644702a2197a tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:13:18.450457 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Acquiring lock "cinder-a1beafd0-f18c-43f1-aed4-1f373593b494-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:18.469393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Lock "cinder-a1beafd0-f18c-43f1-aed4-1f373593b494-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:18.478341 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=49,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=9 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:13:18.540542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:18.630556 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:18.631151 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Volume volume-a1beafd0-f18c-43f1-aed4-1f373593b494 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:18.639842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] deleting rbd volume volume-a1beafd0-f18c-43f1-aed4-1f373593b494 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:18.948592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Created reservations ['09adfd90-f05f-44c0-ac9e-50576ef7ce54', '74cd2f87-1db4-43da-b364-1bb0865dedee', '8fba8c34-e8ed-4662-aa85-2bf1063ea0ce', '7331663f-2765-4fe1-9dae-387e134356b5'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:19.006899 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:19.046761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:19.126204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:19.160265 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Deleted volume successfully.
Oct 08 21:13:19.196890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a726e771-0605-46b3-96aa-227024da8c1d tempest-VolumesActionsTest-1222918553 None] Lock "cinder-a1beafd0-f18c-43f1-aed4-1f373593b494-delete_volume" released by "delete_volume" :: held 0.730s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:20.146990 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:20.189103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (a808c39e-ab28-48dc-9bc9-48e8dc35490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:20.198152 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690d30c9-8293-4854-afc9-fb55e194e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.248056 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690d30c9-8293-4854-afc9-fb55e194e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-775995295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ce33321-9032-4408-96a8-155c94e7d7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75970c62311417eada44e0270dade81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:20Z,use_quota=True,user_id='71e546b55bd1475782e5863ed50b6f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.259130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b497b02-380c-4ba3-ac40-5c901b4f973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.275791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b497b02-380c-4ba3-ac40-5c901b4f973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.289008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf36bd7c-35fd-4cca-89e0-5622cb766209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.293466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf36bd7c-35fd-4cca-89e0-5622cb766209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce33321-9032-4408-96a8-155c94e7d7a6', 'volume_name': 'volume-0ce33321-9032-4408-96a8-155c94e7d7a6', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.299730 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6d56cf-a92e-4fc7-9307-dd225ec31ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.307044 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6d56cf-a92e-4fc7-9307-dd225ec31ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.322209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347e644a-f5e1-46a3-843a-74af33db62c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.324922 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Volume 0ce33321-9032-4408-96a8-155c94e7d7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce33321-9032-4408-96a8-155c94e7d7a6', 'volume_size': 1}
Oct 08 21:13:20.325589 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] creating volume 'volume-0ce33321-9032-4408-96a8-155c94e7d7a6' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:20.326761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:20.447667 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:20.448046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:20.451715 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347e644a-f5e1-46a3-843a-74af33db62c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce33321-9032-4408-96a8-155c94e7d7a6', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.456387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20adc226-b3f5-439a-9aab-30ebaa424180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:20.513211 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Volume volume-0ce33321-9032-4408-96a8-155c94e7d7a6 (0ce33321-9032-4408-96a8-155c94e7d7a6): created successfully
Oct 08 21:13:20.531008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20adc226-b3f5-439a-9aab-30ebaa424180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:20.541594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Flow 'volume_create_manager' (a808c39e-ab28-48dc-9bc9-48e8dc35490c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:20.562428 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9b91a17b-5aa2-43cf-a02d-d34be7ab4f73 tempest-VolumesActionsTest-1575257702 None] Created volume successfully.
Oct 08 21:13:22.332211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Acquiring lock "cinder-0ce33321-9032-4408-96a8-155c94e7d7a6-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:22.369004 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Lock "cinder-0ce33321-9032-4408-96a8-155c94e7d7a6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:22.469616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:22.583042 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:22.583874 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Volume volume-0ce33321-9032-4408-96a8-155c94e7d7a6 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:22.592647 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] deleting rbd volume volume-0ce33321-9032-4408-96a8-155c94e7d7a6 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:23.112245 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Created reservations ['e6afc5df-1992-436d-98f2-07c6ebbfd5f8', '9418210b-9e21-4469-8771-05ca6bccfe9a', '4968bd84-8a27-4930-8cbc-c7fd72b90729', '7e7582b7-da87-45a9-a012-5e17a6485e72'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:23.276987 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:23.384219 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:23.486043 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:23.491722 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Deleted volume successfully.
Oct 08 21:13:23.518363 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9175d75-2916-468c-beaf-9bd4f638fa3b tempest-VolumesActionsTest-1575257702 None] Lock "cinder-0ce33321-9032-4408-96a8-155c94e7d7a6-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:23.742509 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Acquiring lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:23.764518 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:23.889123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:24.005159 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:24.005878 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Volume volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:24.018834 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] deleting rbd volume volume-65a73b75-1e20-49b0-a945-c7bc0e89c9c7 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:24.495487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Created reservations ['0519cf91-a8b9-4565-8a59-5e911252d01c', '9e25a2c2-a87c-4274-bf1d-dbfe05a3c5bb', 'b0b7ea85-a5f0-47de-803a-04e97d58b765', '253a6fb9-b31e-4a8e-b539-86a8c792b4be'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:24.631595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:24.698308 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:24.766387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:24.782141 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Deleted volume successfully.
Oct 08 21:13:24.804720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-12d6063d-f026-442f-aa4a-20c229f5bde0 tempest-VolumesActionsTest-1575257702 None] Lock "cinder-65a73b75-1e20-49b0-a945-c7bc0e89c9c7-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:34.792048 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=32,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:13:36.526347 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:13:36.565453 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Flow 'volume_create_manager' (cd7c62e1-8594-4758-9465-eed51b6e742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:36.584757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6320dd-afa7-419d-9bf3-790b607e3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.616249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6320dd-afa7-419d-9bf3-790b607e3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1017362923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b975a185-ffa1-4f06-82ca-497a3c569853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9319c189186b4639adc4392a14209fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:13:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:13:36Z,use_quota=True,user_id='34519d5169994688ba28db116e249b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.634118 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4491ae-3b27-4365-952c-f716f62e9e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.638490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4491ae-3b27-4365-952c-f716f62e9e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.643434 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee1b9d8-9848-450d-baaf-63f26e5aa925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.659953 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee1b9d8-9848-450d-baaf-63f26e5aa925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b975a185-ffa1-4f06-82ca-497a3c569853', 'volume_name': 'volume-b975a185-ffa1-4f06-82ca-497a3c569853', 'volume_size': 2}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.664958 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1586991a-cbb5-4c98-bb21-2e31be890661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.672426 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1586991a-cbb5-4c98-bb21-2e31be890661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.691598 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7244add4-9514-4b68-b906-c3d347ab2b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.692784 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Volume b975a185-ffa1-4f06-82ca-497a3c569853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b975a185-ffa1-4f06-82ca-497a3c569853', 'volume_size': 2}
Oct 08 21:13:36.702301 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] creating volume 'volume-b975a185-ffa1-4f06-82ca-497a3c569853' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:13:36.703376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:36.821866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:13:36.822430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:13:36.826586 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7244add4-9514-4b68-b906-c3d347ab2b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b975a185-ffa1-4f06-82ca-497a3c569853', 'volume_size': 2}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.833877 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42d6be1-3c09-4237-abc4-7d60b5b4a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:13:36.866764 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Volume volume-b975a185-ffa1-4f06-82ca-497a3c569853 (b975a185-ffa1-4f06-82ca-497a3c569853): created successfully
Oct 08 21:13:36.875026 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42d6be1-3c09-4237-abc4-7d60b5b4a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:13:36.884695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Flow 'volume_create_manager' (cd7c62e1-8594-4758-9465-eed51b6e742e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:13:36.902519 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3c2902b8-690c-47a2-b2a9-902d3b93fe51 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Created volume successfully.
Oct 08 21:13:36.918630 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:13:37.849813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fa80cf7d-0cf2-4fbb-8378-ec077edd1fa4 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:38.316793 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fa80cf7d-0cf2-4fbb-8378-ec077edd1fa4 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Create snapshot completed successfully
Oct 08 21:13:39.268578 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Acquiring lock "cinder-206602aa-6af7-4e10-9ce0-b300798e748a-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:39.280713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Lock "cinder-206602aa-6af7-4e10-9ce0-b300798e748a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:39.301283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:40.447897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Created reservations ['5a938edf-fd52-48e3-88a8-1e8623ad78cb', 'f176f996-0dcd-407c-88a4-2f139b112452', 'ca67c76e-3e35-41c5-b891-c9d15cf87e40', '9cbfe2c9-10f6-4d78-8b1f-8af78b28e53e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:40.530289 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Delete snapshot completed successfully.
Oct 08 21:13:40.544521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8c3b676d-d1ab-4500-9bdf-ec40c46a5763 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Lock "cinder-206602aa-6af7-4e10-9ce0-b300798e748a-delete_snapshot" released by "delete_snapshot" :: held 1.262s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:41.568522 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Acquiring lock "cinder-b975a185-ffa1-4f06-82ca-497a3c569853-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:13:41.604597 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Lock "cinder-b975a185-ffa1-4f06-82ca-497a3c569853-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:13:41.744190 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:41.869617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:13:41.870208 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Volume volume-b975a185-ffa1-4f06-82ca-497a3c569853 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:13:41.879236 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] deleting rbd volume volume-b975a185-ffa1-4f06-82ca-497a3c569853 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:13:42.326900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Created reservations ['710b3181-d741-4a61-b901-e578b67feb5f', 'e72c031f-44d2-48a2-96ca-178cf2160b6e', '49fc6327-4988-4cff-b6a6-c8382428ebf6', '5dda4aed-fdcb-4588-84dc-cc45551b3e3a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:13:42.540439 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:42.636786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:13:42.708562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:13:42.713073 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Deleted volume successfully.
Oct 08 21:13:42.733568 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a87b2d68-b506-42b9-8471-8f0fbf0e8798 tempest-VolumesSnapshotNegativeTestJSON-1511524876 None] Lock "cinder-b975a185-ffa1-4f06-82ca-497a3c569853-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:13:52.718675 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=23,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:14:05.947254 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:14:05.948531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:14:06.008135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:14:06.102456 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:14:12.326057 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:14:12.326721 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=38,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:14:32.338511 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:14:42.339565 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:05.947212 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:15:05.957379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:06.041962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:06.116438 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:12.337731 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:12.341966 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:25.814776 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:25.836401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (5fdbefa5-b242-4e19-b113-03e0233f7825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:25.843397 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d6ee77-e045-4d30-8043-e2b3b8fe0154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:25.865222 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d6ee77-e045-4d30-8043-e2b3b8fe0154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1730275309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=33d9bc65-8877-4a87-b05a-971438a4b5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d2965f2beb43ce8004ca62c59739f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:26Z,use_quota=True,user_id='61b5ebddaf27412da1e7955cff384cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:25.870752 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e8b4e8-61cd-4b0e-9253-1c479e1ffae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:25.876128 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e8b4e8-61cd-4b0e-9253-1c479e1ffae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:25.881621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c82b31a-652b-4cc0-a543-13021e83dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:25.886189 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c82b31a-652b-4cc0-a543-13021e83dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d9bc65-8877-4a87-b05a-971438a4b5bf', 'volume_name': 'volume-33d9bc65-8877-4a87-b05a-971438a4b5bf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:25.893290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50d971b-16b1-424e-ab45-dc35bd4557f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:25.897968 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50d971b-16b1-424e-ab45-dc35bd4557f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:25.904820 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df983df-e5dd-4802-af57-f3f5f50fcbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:25.906490 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Volume 33d9bc65-8877-4a87-b05a-971438a4b5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d9bc65-8877-4a87-b05a-971438a4b5bf', 'volume_size': 1}
Oct 08 21:15:25.907673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] creating volume 'volume-33d9bc65-8877-4a87-b05a-971438a4b5bf' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:25.908786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:26.023057 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:26.023881 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:26.029433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df983df-e5dd-4802-af57-f3f5f50fcbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d9bc65-8877-4a87-b05a-971438a4b5bf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:26.041084 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29324877-ebba-4b89-982b-30c6e7ea903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:26.059819 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-33d9bc65-8877-4a87-b05a-971438a4b5bf (33d9bc65-8877-4a87-b05a-971438a4b5bf): created successfully
Oct 08 21:15:26.067161 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29324877-ebba-4b89-982b-30c6e7ea903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:26.075293 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (5fdbefa5-b242-4e19-b113-03e0233f7825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:26.113155 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2dab200a-5fdc-40f3-bed8-50618be4e969 tempest-VolumesListAdminTestJSON-88312233 None] Created volume successfully.
Oct 08 21:15:27.496574 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:27.524273 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (291c254b-bc56-4dd5-8a04-b41ce35a0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:27.531137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf37bd-d909-42f7-b315-2beb7e033bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.552769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf37bd-d909-42f7-b315-2beb7e033bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-626751624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9bda06fe-6be4-47f6-ba31-c8c677186654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d2965f2beb43ce8004ca62c59739f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:27Z,use_quota=True,user_id='61b5ebddaf27412da1e7955cff384cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.559213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f4123d-b62d-400b-a3c2-a65d6126bee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.566106 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f4123d-b62d-400b-a3c2-a65d6126bee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.571700 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eec86f8-7eb7-4e31-96fc-76d3c4d7fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.576238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eec86f8-7eb7-4e31-96fc-76d3c4d7fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bda06fe-6be4-47f6-ba31-c8c677186654', 'volume_name': 'volume-9bda06fe-6be4-47f6-ba31-c8c677186654', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.582374 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0279d1-0432-49ef-abf0-73e703269a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.587300 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0279d1-0432-49ef-abf0-73e703269a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.592663 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e3ddc4-371a-4623-a2d1-e1e3f534ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.595577 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Volume 9bda06fe-6be4-47f6-ba31-c8c677186654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bda06fe-6be4-47f6-ba31-c8c677186654', 'volume_size': 1}
Oct 08 21:15:27.596157 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] creating volume 'volume-9bda06fe-6be4-47f6-ba31-c8c677186654' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:27.596983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:27.718827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:27.722325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:27.726255 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e3ddc4-371a-4623-a2d1-e1e3f534ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bda06fe-6be4-47f6-ba31-c8c677186654', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.736905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4346fc4a-dced-442e-a620-fae7087222c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:27.770900 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-9bda06fe-6be4-47f6-ba31-c8c677186654 (9bda06fe-6be4-47f6-ba31-c8c677186654): created successfully
Oct 08 21:15:27.774494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4346fc4a-dced-442e-a620-fae7087222c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:27.789757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (291c254b-bc56-4dd5-8a04-b41ce35a0176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:27.808059 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3fa53dc6-4a0c-412e-ac7a-b558925969ec tempest-VolumesListAdminTestJSON-88312233 None] Created volume successfully.
Oct 08 21:15:29.348338 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:29.390482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (902cb5cb-f1e2-4b06-8867-185c90da8025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:29.403804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d5685-858f-4557-86fb-e015b823a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.437301 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d5685-858f-4557-86fb-e015b823a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1202307945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=62407528-6d0d-4776-85b7-82af25e008c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d2965f2beb43ce8004ca62c59739f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:29Z,use_quota=True,user_id='61b5ebddaf27412da1e7955cff384cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.444718 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bcf0f0-a422-4df5-9c4d-09b54fba82a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.449643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bcf0f0-a422-4df5-9c4d-09b54fba82a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.459251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6005871-0ca6-4bfc-925c-8cc1932b258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.467378 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6005871-0ca6-4bfc-925c-8cc1932b258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62407528-6d0d-4776-85b7-82af25e008c5', 'volume_name': 'volume-62407528-6d0d-4776-85b7-82af25e008c5', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.476373 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb631412-c22f-45cc-ae8c-be0f3dd5fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.480779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb631412-c22f-45cc-ae8c-be0f3dd5fc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.498798 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ad8ab8-4133-40cd-bf1e-698a415fd9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.500205 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Volume 62407528-6d0d-4776-85b7-82af25e008c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62407528-6d0d-4776-85b7-82af25e008c5', 'volume_size': 1}
Oct 08 21:15:29.501800 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] creating volume 'volume-62407528-6d0d-4776-85b7-82af25e008c5' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:29.502835 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:29.611454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:29.612246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:29.618128 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ad8ab8-4133-40cd-bf1e-698a415fd9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62407528-6d0d-4776-85b7-82af25e008c5', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.628745 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e005e-9223-4853-ab08-583b1c73e254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:29.712595 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-62407528-6d0d-4776-85b7-82af25e008c5 (62407528-6d0d-4776-85b7-82af25e008c5): created successfully
Oct 08 21:15:29.716323 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e005e-9223-4853-ab08-583b1c73e254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:29.726109 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Flow 'volume_create_manager' (902cb5cb-f1e2-4b06-8867-185c90da8025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:29.747276 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9c1835e7-e125-4c2a-bafa-5d2c831949d9 tempest-VolumesListAdminTestJSON-88312233 None] Created volume successfully.
Oct 08 21:15:31.290916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:31.330644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Flow 'volume_create_manager' (9b661165-ddbf-479f-a775-39b4880c3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:31.338019 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7ad523-6769-40c2-b5e0-6b53e4c92bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.378773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7ad523-6769-40c2-b5e0-6b53e4c92bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=da2776d6-2325-4054-a91f-10c09c30cca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a518846c18b45a195227125c9a71c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:31Z,use_quota=True,user_id='73cea88f6c41419abf208ea235ea2a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.386131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21dbcad-9995-402f-9581-5be7eb0dae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.394937 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21dbcad-9995-402f-9581-5be7eb0dae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.405827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcd3d37-b9d7-4005-b029-357d4c0f5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.411818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcd3d37-b9d7-4005-b029-357d4c0f5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2776d6-2325-4054-a91f-10c09c30cca2', 'volume_name': 'volume-da2776d6-2325-4054-a91f-10c09c30cca2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.421915 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac5275f-9967-40f8-9a71-c155905ce4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.428569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac5275f-9967-40f8-9a71-c155905ce4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.436323 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1ca04e-9c5a-49ee-a0d4-7c48979c3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.440252 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Volume da2776d6-2325-4054-a91f-10c09c30cca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2776d6-2325-4054-a91f-10c09c30cca2', 'volume_size': 1}
Oct 08 21:15:31.441065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] creating volume 'volume-da2776d6-2325-4054-a91f-10c09c30cca2' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:31.442866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:31.570575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:31.571262 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:31.575498 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1ca04e-9c5a-49ee-a0d4-7c48979c3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2776d6-2325-4054-a91f-10c09c30cca2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.581402 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0f9eb3-a673-4f08-b97e-6b7a36f0b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:31.593873 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Volume volume-da2776d6-2325-4054-a91f-10c09c30cca2 (da2776d6-2325-4054-a91f-10c09c30cca2): created successfully
Oct 08 21:15:31.600309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0f9eb3-a673-4f08-b97e-6b7a36f0b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:31.610283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Flow 'volume_create_manager' (9b661165-ddbf-479f-a775-39b4880c3c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:31.628053 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-537eb406-a18c-48f6-8217-5bc31328f9af tempest-VolumesListAdminTestJSON-1735974974 None] Created volume successfully.
Oct 08 21:15:32.488283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Acquiring lock "cinder-da2776d6-2325-4054-a91f-10c09c30cca2-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:15:32.506918 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Lock "cinder-da2776d6-2325-4054-a91f-10c09c30cca2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:15:32.559720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:32.696229 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:15:32.696825 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Volume volume-da2776d6-2325-4054-a91f-10c09c30cca2 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:15:32.708009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] deleting rbd volume volume-da2776d6-2325-4054-a91f-10c09c30cca2 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:15:32.712303 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Acquiring lock "cinder-62407528-6d0d-4776-85b7-82af25e008c5-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:15:32.728867 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-62407528-6d0d-4776-85b7-82af25e008c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:15:32.803951 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:32.903009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:15:32.903745 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-62407528-6d0d-4776-85b7-82af25e008c5 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:15:32.916812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] deleting rbd volume volume-62407528-6d0d-4776-85b7-82af25e008c5 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:15:33.161286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Created reservations ['aad85b14-61e0-4695-a117-0f83ed681bd2', 'efa8d210-9d9c-48f7-9ec3-61dad7dffb6a', '6103ff06-2e54-4da7-b8c9-ff8fc0b9ee54', '8fe565a3-46bc-482e-afef-515bbbf4f6ac'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:15:33.258379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:33.324195 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:33.371541 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:33.408011 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Deleted volume successfully.
Oct 08 21:15:33.435319 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f65bd59a-391f-4d2a-a99f-aa39496df8a0 tempest-VolumesListAdminTestJSON-1735974974 None] Lock "cinder-da2776d6-2325-4054-a91f-10c09c30cca2-delete_volume" released by "delete_volume" :: held 0.928s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:15:33.455281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Created reservations ['53990e14-3237-4f5b-8b51-e04604162a70', '572a9b2a-74a0-46be-9512-9df6c8865d3e', 'eecd369b-40f5-4acf-b592-841798d0c455', '69c43237-425a-42e6-828d-743230d3bebe'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:15:33.533946 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:33.595660 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:33.663926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:33.668857 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Deleted volume successfully.
Oct 08 21:15:33.686571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c4d5ea2a-59ae-4833-b808-887abd875f22 tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-62407528-6d0d-4776-85b7-82af25e008c5-delete_volume" released by "delete_volume" :: held 0.957s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:15:33.837508 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Acquiring lock "cinder-9bda06fe-6be4-47f6-ba31-c8c677186654-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:15:33.857425 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-9bda06fe-6be4-47f6-ba31-c8c677186654-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:15:33.922639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:34.034185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:15:34.034629 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-9bda06fe-6be4-47f6-ba31-c8c677186654 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:15:34.048738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] deleting rbd volume volume-9bda06fe-6be4-47f6-ba31-c8c677186654 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:15:34.515992 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Created reservations ['6f1ecc05-f4b1-40d1-9dd2-47487932ac7c', '6cf64733-a274-4358-9a0c-554f95c3f9a6', '36291b85-eda6-453b-98cd-1ff24c50c3bd', '58997dfa-a161-4f03-9629-f93a60fad6b1'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:15:34.588702 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:34.596087 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:34.659247 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:34.782834 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:34.796480 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Deleted volume successfully.
Oct 08 21:15:34.830847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4bce332f-2843-4cd8-81f4-69fba82f35e6 tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-9bda06fe-6be4-47f6-ba31-c8c677186654-delete_volume" released by "delete_volume" :: held 0.976s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:15:35.073394 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Acquiring lock "cinder-33d9bc65-8877-4a87-b05a-971438a4b5bf-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:15:35.087408 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-33d9bc65-8877-4a87-b05a-971438a4b5bf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:15:35.159735 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:35.238548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:15:35.238548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Volume volume-33d9bc65-8877-4a87-b05a-971438a4b5bf is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:15:35.252102 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] deleting rbd volume volume-33d9bc65-8877-4a87-b05a-971438a4b5bf {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:15:35.525017 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:35.536111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Created reservations ['7b186c93-0b04-440d-90ee-374cba0e75ef', 'bd48b4f2-0ec9-449f-b13b-fac2e77202cd', '41306297-f861-4afd-a3ea-a683e6f091bd', '07a7041f-a952-4af6-bbc1-6a78da21c556'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:15:35.608700 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:35.667038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:35.719035 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:35.724820 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Deleted volume successfully.
Oct 08 21:15:35.739817 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-309b86c0-f328-4821-9e54-b6b4c19d9d1e tempest-VolumesListAdminTestJSON-88312233 None] Lock "cinder-33d9bc65-8877-4a87-b05a-971438a4b5bf-delete_volume" released by "delete_volume" :: held 0.652s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:15:43.946122 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:44.084850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (f8dac886-3f01-4334-81f6-cc7972f3e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:44.121610 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc717ea-23c5-4a36-b412-c30530fadba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.189673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc717ea-23c5-4a36-b412-c30530fadba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1391294713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=71c4c902-18fd-4291-83f7-50d37cc1baef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d29b90ab34abbadd21edbca637d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:44Z,use_quota=True,user_id='8957041987c8487099f0d89f4c64af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.219826 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ffc0ab-4868-4566-b974-004e7c5f1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.233063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ffc0ab-4868-4566-b974-004e7c5f1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.252550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f562054-f741-4663-8f60-930a86682ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.269739 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f562054-f741-4663-8f60-930a86682ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c4c902-18fd-4291-83f7-50d37cc1baef', 'volume_name': 'volume-71c4c902-18fd-4291-83f7-50d37cc1baef', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.285962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce0776-85db-4072-8d77-f6ea6b060802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.302264 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce0776-85db-4072-8d77-f6ea6b060802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.322392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a0023-bb11-4b33-bcbf-62af2c2b81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.325171 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Volume 71c4c902-18fd-4291-83f7-50d37cc1baef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c4c902-18fd-4291-83f7-50d37cc1baef', 'volume_size': 1}
Oct 08 21:15:44.326720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] creating volume 'volume-71c4c902-18fd-4291-83f7-50d37cc1baef' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:44.329784 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:44.516133 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:44.516541 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:44.521302 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a0023-bb11-4b33-bcbf-62af2c2b81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c4c902-18fd-4291-83f7-50d37cc1baef', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.526134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbec4fc4-db15-4c2c-8866-858bd99e828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.534873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:44.565151 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Flow 'volume_create_manager' (1f6e24e3-2047-4b59-8c0c-866500643f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:44.573860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b391e851-2351-4bfa-b8a8-44eb620a281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.580818 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-71c4c902-18fd-4291-83f7-50d37cc1baef (71c4c902-18fd-4291-83f7-50d37cc1baef): created successfully
Oct 08 21:15:44.585910 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbec4fc4-db15-4c2c-8866-858bd99e828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.591858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (f8dac886-3f01-4334-81f6-cc7972f3e681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:44.616073 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b391e851-2351-4bfa-b8a8-44eb620a281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-259288687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6970076b9341de9781166a8502d776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:44Z,use_quota=True,user_id='d6708073d4c54435899f2a0a8565ca08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.622191 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae61109d-1fdf-4327-9d8a-f70d5647f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.627672 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae61109d-1fdf-4327-9d8a-f70d5647f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.632449 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85931433-176e-4852-9c0b-0b92f1390a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.637895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85931433-176e-4852-9c0b-0b92f1390a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083', 'volume_name': 'volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083', 'volume_size': 2}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.644038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff0a60e-a244-41be-b40e-04ebbabec141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.658386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff0a60e-a244-41be-b40e-04ebbabec141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.664149 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d6a0b0-1806-4b8e-82dc-d4a65140cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.665492 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Volume 22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083', 'volume_size': 2}
Oct 08 21:15:44.666044 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] creating volume 'volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:44.666879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:44.734562 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f65fef11-7de9-447c-94b5-b427d40771d0 tempest-AttachVolumeNegativeTest-1956575659 None] Created volume successfully.
Oct 08 21:15:44.778716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:44.779511 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:44.784608 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d6a0b0-1806-4b8e-82dc-d4a65140cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083', 'volume_size': 2}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.792653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03307139-9332-44a4-8ad4-4b2578e7e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:44.806602 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Volume volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083 (22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083): created successfully
Oct 08 21:15:44.813791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03307139-9332-44a4-8ad4-4b2578e7e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:44.823351 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Flow 'volume_create_manager' (1f6e24e3-2047-4b59-8c0c-866500643f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:44.842391 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53ca1bce-b358-4fd8-bb4e-1767d3f71e1e tempest-VolumesCloneNegativeTest-1751851390 None] Created volume successfully.
Oct 08 21:15:45.675119 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-91d45c9f-1da8-4b88-804e-8adab470c4d2 req-199fdeb0-5dc4-4630-9d7a-cb36fd0a3df1 tempest-AttachVolumeNegativeTest-1956575659 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:15:45.724419 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Acquiring lock "cinder-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:15:45.754863 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Lock "cinder-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:15:45.848548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:45.946439 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:15:45.947167 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Volume volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:15:45.966923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] deleting rbd volume volume-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:15:46.390948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Created reservations ['f4416ef9-baac-4258-95a0-612b62936bbe', 'd3d997e4-d4a4-466d-9d39-a484b04b6542', 'a8a133f1-78b5-46ff-b237-5f47ddd3b6e1', 'c61a89d2-f952-41d8-9b91-af20d4268ed6'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:15:46.503271 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:46.594235 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:46.660295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:15:46.674383 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Deleted volume successfully.
Oct 08 21:15:46.700961 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d827896a-80f6-4b00-94c3-98cf0d303632 tempest-VolumesCloneNegativeTest-1751851390 None] Lock "cinder-22ed0b2b-1e3a-4acb-8b27-3ba2e1d1f083-delete_volume" released by "delete_volume" :: held 0.946s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:15:47.408047 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-91d45c9f-1da8-4b88-804e-8adab470c4d2 req-199fdeb0-5dc4-4630-9d7a-cb36fd0a3df1 tempest-AttachVolumeNegativeTest-1956575659 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.733s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:15:47.409265 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-91d45c9f-1da8-4b88-804e-8adab470c4d2 req-199fdeb0-5dc4-4630-9d7a-cb36fd0a3df1 tempest-AttachVolumeNegativeTest-1956575659 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-71c4c902-18fd-4291-83f7-50d37cc1baef', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '71c4c902-18fd-4291-83f7-50d37cc1baef', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:15:47.462406 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-91d45c9f-1da8-4b88-804e-8adab470c4d2 req-199fdeb0-5dc4-4630-9d7a-cb36fd0a3df1 tempest-AttachVolumeNegativeTest-1956575659 None] Connection info returned from driver {'name': 'volumes/volume-71c4c902-18fd-4291-83f7-50d37cc1baef', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '71c4c902-18fd-4291-83f7-50d37cc1baef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6d94682-f321-42f8-883e-e41bad92dd8e'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:15:47.569614 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-91d45c9f-1da8-4b88-804e-8adab470c4d2 req-199fdeb0-5dc4-4630-9d7a-cb36fd0a3df1 tempest-AttachVolumeNegativeTest-1956575659 None] attachment_update completed successfully.
Oct 08 21:15:53.004354 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:53.058357 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (13702c52-71b0-41bb-bc9e-1db7bc932798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:53.069250 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f2a58-567b-458d-a656-d0de0d68dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.103456 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f2a58-567b-458d-a656-d0de0d68dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1981791563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=afd067e0-0ee2-4c4a-a3a0-9aabf46beda1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e30a611f6a4275ad45c71c3e8cc569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:53Z,use_quota=True,user_id='2131126b6717405198c779d8c7198532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.112853 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d4f5e3-45b9-48c1-8add-5164e3e00ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.120506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d4f5e3-45b9-48c1-8add-5164e3e00ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.126242 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5445f6e-4111-4634-9685-686522c1424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.131767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5445f6e-4111-4634-9685-686522c1424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd067e0-0ee2-4c4a-a3a0-9aabf46beda1', 'volume_name': 'volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.136929 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465e5287-1a6d-4444-b74b-229a67f509c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.141592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465e5287-1a6d-4444-b74b-229a67f509c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.146600 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e52ca7-940c-4ecc-9bec-1c6705ba8fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.147976 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Volume afd067e0-0ee2-4c4a-a3a0-9aabf46beda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1', 'volume_size': 1}
Oct 08 21:15:53.148710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] creating volume 'volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:53.149716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:53.280617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:53.281022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:53.285163 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e52ca7-940c-4ecc-9bec-1c6705ba8fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.293218 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4dc547-9a08-4df8-9eb8-df1207765308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:53.317618 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Volume volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1 (afd067e0-0ee2-4c4a-a3a0-9aabf46beda1): created successfully
Oct 08 21:15:53.321920 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4dc547-9a08-4df8-9eb8-df1207765308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:53.327635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (13702c52-71b0-41bb-bc9e-1db7bc932798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:53.347813 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-acf0f093-7efb-4ec6-829a-8ef4e650dfbf tempest-VolumesListTestJSON-1240142837 None] Created volume successfully.
Oct 08 21:15:54.872354 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:54.902515 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (9923330a-bffb-4cac-bed8-ae47912cef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:54.911233 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c8e9e4-1386-46f4-a029-5caa06b52ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:54.939108 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c8e9e4-1386-46f4-a029-5caa06b52ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-806783188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f629bf6-157d-4f2e-be1f-dfb96205f51b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e30a611f6a4275ad45c71c3e8cc569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:55Z,use_quota=True,user_id='2131126b6717405198c779d8c7198532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:54.948066 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873b0818-9893-4240-8e6f-f1a96c9fa85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:54.952444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873b0818-9893-4240-8e6f-f1a96c9fa85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:54.958568 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2224e42-0420-4379-84e1-02e2216d0739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:54.962793 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2224e42-0420-4379-84e1-02e2216d0739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f629bf6-157d-4f2e-be1f-dfb96205f51b', 'volume_name': 'volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:54.969849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b28c97-8441-4a3a-bb05-23454ce6e23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:54.976583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b28c97-8441-4a3a-bb05-23454ce6e23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:54.982991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bc7d2b-570e-4e6d-9bea-e8d41f1d74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:54.987304 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Volume 1f629bf6-157d-4f2e-be1f-dfb96205f51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b', 'volume_size': 1}
Oct 08 21:15:54.989139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] creating volume 'volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:54.990178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:55.095206 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:55.095771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:55.101240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bc7d2b-570e-4e6d-9bea-e8d41f1d74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:55.111604 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb222637-a51c-44d4-8317-cdb92cf70370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:55.133903 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Volume volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b (1f629bf6-157d-4f2e-be1f-dfb96205f51b): created successfully
Oct 08 21:15:55.137592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb222637-a51c-44d4-8317-cdb92cf70370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:55.143487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (9923330a-bffb-4cac-bed8-ae47912cef68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:55.161621 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2adbf0cf-6832-4809-b329-58bd140e8cf0 tempest-VolumesListTestJSON-1240142837 None] Created volume successfully.
Oct 08 21:15:56.539401 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:15:56.564799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:15:56.601881 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (d282e216-fb2f-4e64-8515-c27deec07b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:56.612677 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fea1bbd-c517-4e15-b6d9-01d717eb0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.636880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fea1bbd-c517-4e15-b6d9-01d717eb0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-765660757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0c553a7-fb56-4663-a542-64ae0651dcee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19e30a611f6a4275ad45c71c3e8cc569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:15:56Z,use_quota=True,user_id='2131126b6717405198c779d8c7198532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.642574 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff55dd93-b330-4749-9cc5-f19076e5c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.647079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff55dd93-b330-4749-9cc5-f19076e5c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.652332 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995a3a8e-f38c-4665-b273-d3492b1274e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.657577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995a3a8e-f38c-4665-b273-d3492b1274e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c553a7-fb56-4663-a542-64ae0651dcee', 'volume_name': 'volume-a0c553a7-fb56-4663-a542-64ae0651dcee', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.663429 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0f083b-b118-4221-8d10-184e5a4f2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.673978 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0f083b-b118-4221-8d10-184e5a4f2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.680798 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9a6b0f-3cae-4c8d-bbd4-83e4763d276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.682158 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Volume a0c553a7-fb56-4663-a542-64ae0651dcee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c553a7-fb56-4663-a542-64ae0651dcee', 'volume_size': 1}
Oct 08 21:15:56.682779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] creating volume 'volume-a0c553a7-fb56-4663-a542-64ae0651dcee' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:15:56.683880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:15:56.825813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:15:56.826431 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:15:56.831895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9a6b0f-3cae-4c8d-bbd4-83e4763d276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c553a7-fb56-4663-a542-64ae0651dcee', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.840517 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6cd500-d3e5-4c16-9d28-adec2b58183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:15:56.870035 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Volume volume-a0c553a7-fb56-4663-a542-64ae0651dcee (a0c553a7-fb56-4663-a542-64ae0651dcee): created successfully
Oct 08 21:15:56.874100 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6cd500-d3e5-4c16-9d28-adec2b58183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:15:56.891826 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Flow 'volume_create_manager' (d282e216-fb2f-4e64-8515-c27deec07b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:15:56.911724 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eb97c9e3-a165-42a5-955a-d140ace8f42f tempest-VolumesListTestJSON-1240142837 None] Created volume successfully.
Oct 08 21:16:02.140823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Acquiring lock "cinder-a0c553a7-fb56-4663-a542-64ae0651dcee-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:16:02.163734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-a0c553a7-fb56-4663-a542-64ae0651dcee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:16:02.256743 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:02.384000 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:16:02.384430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Volume volume-a0c553a7-fb56-4663-a542-64ae0651dcee is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:16:02.396890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] deleting rbd volume volume-a0c553a7-fb56-4663-a542-64ae0651dcee {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:16:02.831613 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Created reservations ['a19a4415-3295-4c40-9ff3-8c62b3dae265', 'b7960a80-5053-4c1b-b6a0-67f7d4432fc2', 'b4a72b32-0481-432d-a779-0f62c29c75f2', 'c43ecb7a-07ab-4247-970d-1530998ec37d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:16:02.957909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:03.050278 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:03.121077 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:16:03.126842 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Deleted volume successfully.
Oct 08 21:16:03.145056 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-89d94d8e-2baf-4dbc-bd09-ab934b567a7a tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-a0c553a7-fb56-4663-a542-64ae0651dcee-delete_volume" released by "delete_volume" :: held 0.981s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:16:03.397600 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Acquiring lock "cinder-1f629bf6-157d-4f2e-be1f-dfb96205f51b-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:16:03.427004 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-1f629bf6-157d-4f2e-be1f-dfb96205f51b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:16:03.525979 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=32,cinder:INSERT=3,cinder:DELETE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:16:03.532334 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:03.627849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:16:03.628209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Volume volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:16:03.636770 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] deleting rbd volume volume-1f629bf6-157d-4f2e-be1f-dfb96205f51b {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:16:04.108569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Created reservations ['8252dafe-a4d3-4482-aede-96bb1798261c', '7e27a669-b7dc-4498-81af-ce4d458683e9', '2e986843-64a9-4302-bb98-9a10dcc900f4', 'd3e18e76-361c-4a14-b7c0-b4e4fe68431a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:16:04.233428 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:04.307416 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:04.395941 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:16:04.403910 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Deleted volume successfully.
Oct 08 21:16:04.431030 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-42056ea7-9ad0-46ae-bd04-ff5b57acafbd tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-1f629bf6-157d-4f2e-be1f-dfb96205f51b-delete_volume" released by "delete_volume" :: held 1.004s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:16:04.689754 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Acquiring lock "cinder-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:16:04.703748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:16:04.816008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:04.911115 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:16:04.911571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Volume volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:16:04.922900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] deleting rbd volume volume-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:16:05.359845 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Created reservations ['68650b76-f7dc-486c-a054-21a36156a064', '851f29be-fe3e-4328-afc5-b060d82a5ab2', '5dfbd4dc-2c8f-4285-bf2f-24ae20e6095d', 'ab483f56-5613-43b8-a615-59f8defa5247'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:16:05.455747 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:05.551185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:05.613647 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:16:05.620418 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Deleted volume successfully.
Oct 08 21:16:05.645362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-a9ed06d8-27d4-4c04-a03d-2085c0b95ed8 tempest-VolumesListTestJSON-1240142837 None] Lock "cinder-afd067e0-0ee2-4c4a-a3a0-9aabf46beda1-delete_volume" released by "delete_volume" :: held 0.942s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:16:05.952346 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:16:05.953241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:06.015129 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:06.072734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:16:15.971295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:16:15.998464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (2a39482a-6af2-4297-ab9f-d891c2c367a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:16:16.009060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1e08ce-cd24-4c84-bbd9-105e35f76fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.030102 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1e08ce-cd24-4c84-bbd9-105e35f76fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1885792326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6e294ba-6781-4b55-bc1c-d34d92ef1ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:16:16Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.037032 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c612d8a5-fa4e-46eb-8cc5-8f7941c8c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.043644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c612d8a5-fa4e-46eb-8cc5-8f7941c8c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.052775 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb0f9a4-670a-4a70-a4c3-179edc213461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.058146 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb0f9a4-670a-4a70-a4c3-179edc213461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'volume_name': 'volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.066756 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbda278-c906-493d-823d-b23ef2fb641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.072267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbda278-c906-493d-823d-b23ef2fb641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.077890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4193e80-c2aa-4ff5-89c4-824da3becef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.079832 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Volume e6e294ba-6781-4b55-bc1c-d34d92ef1ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'volume_size': 1}
Oct 08 21:16:16.080431 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] creating volume 'volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:16:16.081454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:16.202288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:16:16.203254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:16:16.207215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4193e80-c2aa-4ff5-89c4-824da3becef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.211652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8a9010-224a-46e3-b3b1-f44c4acbb9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:16:16.233746 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3 (e6e294ba-6781-4b55-bc1c-d34d92ef1ea3): created successfully
Oct 08 21:16:16.238615 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8a9010-224a-46e3-b3b1-f44c4acbb9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:16:16.248911 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (2a39482a-6af2-4297-ab9f-d891c2c367a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:16:16.274294 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e03bc840-2ffd-495b-b500-4e004464da80 tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:16:17.397531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ffd86fab-b002-41a2-a626-66a823c96386 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:17.980999 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ffd86fab-b002-41a2-a626-66a823c96386 tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:16:19.075585 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.driver [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Creating a new backup for volume volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3. {{(pid=133344) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1218}}
Oct 08 21:16:19.131866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] cloning volumes/volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3@snapshot-794709fa-e84e-498e-91fb-d7d9dc818bf7 to volume-e5f45506-884c-48da-8d06-d7f933914f88 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:16:19.132870 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:19.230867 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:19.394931 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:16:19.395440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:16:19.403412 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:19.505666 ncdv-master-1 cinder-volume[133344]: WARNING cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues
Oct 08 21:16:19.559790 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:16:18Z,data_timestamp=2022-10-08T21:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-595763798',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=40ea5c83-9786-461a-91f9-565eaa5ad76c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6fdea37d91ed431aa0dc780148174e5b',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='794709fa-e84e-498e-91fb-d7d9dc818bf7',status='creating',temp_snapshot_id=None,temp_volume_id='e5f45506-884c-48da-8d06-d7f933914f88',updated_at=None,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_id=e6e294ba-6781-4b55-bc1c-d34d92ef1ea3)
Oct 08 21:16:19.568031 ncdv-master-1 cinder-volume[133344]: INFO cinder.rpc [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Oct 08 21:16:19.574466 ncdv-master-1 cinder-volume[133344]: INFO cinder.rpc [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Oct 08 21:16:19.576739 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] continue_backup in rpcapi backup_id 40ea5c83-9786-461a-91f9-565eaa5ad76c {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:16:22.403934 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=31,cinder:DELETE=3,cinder:SELECT=58,cinder:INSERT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:16:29.241497 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:16:30.448363 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.208s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:16:30.449691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5f45506-884c-48da-8d06-d7f933914f88', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'e5f45506-884c-48da-8d06-d7f933914f88', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:16:30.480126 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Initialize volume connection completed successfully.
Oct 08 21:16:42.410189 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=42,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:16:47.615908 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Terminate volume connection completed successfully.
Oct 08 21:16:47.637097 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Remove volume export completed successfully.
Oct 08 21:16:47.691241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-e5f45506-884c-48da-8d06-d7f933914f88-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:16:47.705608 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-e5f45506-884c-48da-8d06-d7f933914f88-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:16:47.727903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:16:47.852068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:16:47.877340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-e5f45506-884c-48da-8d06-d7f933914f88 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:16:48.326218 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:16:48.333134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cb4189d-8708-489e-8deb-063c5d94ab0c tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-e5f45506-884c-48da-8d06-d7f933914f88-delete_volume" released by "delete_volume" :: held 0.627s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:17:02.434962 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:17:05.952039 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:17:05.952616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:06.027531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:06.118580 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:17:09.460796 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-5c320055-6188-4cee-bab4-b8bf04df5f24 req-9fad4bab-4093-45cd-9329-81d40dfd9f45 tempest-AttachVolumeNegativeTest-1956575659 None] Terminate volume connection completed successfully.
Oct 08 21:17:09.461796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-5c320055-6188-4cee-bab4-b8bf04df5f24 req-9fad4bab-4093-45cd-9329-81d40dfd9f45 tempest-AttachVolumeNegativeTest-1956575659 None] Deleting attachment d6d94682-f321-42f8-883e-e41bad92dd8e. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:17:14.844006 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:17:14.877582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:17:14.912428 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (86bfc6c9-004d-480e-8d9f-a45f81793e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:17:14.928476 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b33394-3c86-470d-9400-92227b7ee830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:14.964923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b33394-3c86-470d-9400-92227b7ee830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493146000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=345abd03-d885-42f6-826d-f0d74c528f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:17:15Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:14.973368 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdc4d40-8341-4322-a043-696cdb4fbe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:14.980935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdc4d40-8341-4322-a043-696cdb4fbe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:14.987959 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c905801-1bb4-425f-953b-8b4ef85be113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:15.094737 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c905801-1bb4-425f-953b-8b4ef85be113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '345abd03-d885-42f6-826d-f0d74c528f9c', 'volume_name': 'volume-345abd03-d885-42f6-826d-f0d74c528f9c', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b28c580>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:15.100930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920a1a3c-9944-44f2-aecf-497c54a5b3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:15.106204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920a1a3c-9944-44f2-aecf-497c54a5b3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:15.112036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4585a8-a0ee-4399-b771-5726b6534949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:15.113499 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Volume 345abd03-d885-42f6-826d-f0d74c528f9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-345abd03-d885-42f6-826d-f0d74c528f9c', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b28c580>}
Oct 08 21:17:15.114179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Cloning 345abd03-d885-42f6-826d-f0d74c528f9c from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:17:15.116241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:17:15.130062 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:17:15.142098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 17, 15, 135443)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:17:15.143548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:17:15.144095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:17:15.152472 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:17:15.154543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:17:15.166356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 17, 15, 161549)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:17:15.167433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:17:15.168365 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:17:15.183550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:15.256837 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] creating snapshot='volume-345abd03-d885-42f6-826d-f0d74c528f9c.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:17:16.210497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-345abd03-d885-42f6-826d-f0d74c528f9c.clone_snap' to 'volume-345abd03-d885-42f6-826d-f0d74c528f9c' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:17:16.461377 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:17:16.462893 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:17:16.463440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:17:16.518123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:17:16.519389 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Marking volume 345abd03-d885-42f6-826d-f0d74c528f9c as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:17:16.545947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 345abd03-d885-42f6-826d-f0d74c528f9c. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:17:16.546365 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Creating volume glance metadata for volume 345abd03-d885-42f6-826d-f0d74c528f9c backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:17:16.731693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4585a8-a0ee-4399-b771-5726b6534949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345abd03-d885-42f6-826d-f0d74c528f9c', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b28c580>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:16.742372 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822b0ccf-93ee-43ac-a272-9ce684b41ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:16.781177 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-345abd03-d885-42f6-826d-f0d74c528f9c (345abd03-d885-42f6-826d-f0d74c528f9c): created successfully
Oct 08 21:17:16.789083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822b0ccf-93ee-43ac-a272-9ce684b41ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:16.813761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (86bfc6c9-004d-480e-8d9f-a45f81793e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:17:16.836924 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ba1ed758-f0b0-4876-9ed7-4e07724c7c8d tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:17:18.149536 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-3530d036-0992-4224-87a3-4500de7bc026 req-379ff3d6-7d56-4121-85bf-b11fce01c111 tempest-VolumesSnapshotTestJSON-547814895 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:17:19.716003 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-3530d036-0992-4224-87a3-4500de7bc026 req-379ff3d6-7d56-4121-85bf-b11fce01c111 tempest-VolumesSnapshotTestJSON-547814895 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.572s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:17:19.718489 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-3530d036-0992-4224-87a3-4500de7bc026 req-379ff3d6-7d56-4121-85bf-b11fce01c111 tempest-VolumesSnapshotTestJSON-547814895 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-345abd03-d885-42f6-826d-f0d74c528f9c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '345abd03-d885-42f6-826d-f0d74c528f9c', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:17:19.782622 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-3530d036-0992-4224-87a3-4500de7bc026 req-379ff3d6-7d56-4121-85bf-b11fce01c111 tempest-VolumesSnapshotTestJSON-547814895 None] Connection info returned from driver {'name': 'volumes/volume-345abd03-d885-42f6-826d-f0d74c528f9c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '345abd03-d885-42f6-826d-f0d74c528f9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '336c2859-005e-4be3-ad9f-154f1a354da8'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:17:19.895254 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-3530d036-0992-4224-87a3-4500de7bc026 req-379ff3d6-7d56-4121-85bf-b11fce01c111 tempest-VolumesSnapshotTestJSON-547814895 None] attachment_update completed successfully.
Oct 08 21:17:23.245544 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-49b919d0-7e42-42da-a8d1-da2abd49b61f tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:24.678324 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-49b919d0-7e42-42da-a8d1-da2abd49b61f tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:17:25.663732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-95d567bd-1808-4ac9-b77d-59c21318939d tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:26.677165 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-95d567bd-1808-4ac9-b77d-59c21318939d tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:17:27.343417 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d91d2c1-1c27-424c-b205-49b221790b20 tempest-BackendsCapabilitiesAdminTestsJSON-115402220 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f438dab4-bd55-4179-95aa-b7d3f1d6edb3:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133344) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Oct 08 21:17:27.428942 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-779a47b8-fb1e-4d65-a10e-a175b3533a85 tempest-BackendsCapabilitiesAdminTestsJSON-115402220 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f438dab4-bd55-4179-95aa-b7d3f1d6edb3:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133344) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Oct 08 21:17:28.243786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c837fd2e-c3be-4ede-8cee-65a1610f2ccc tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:28.677027 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=69,cinder:UPDATE=11,cinder:INSERT=19,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:17:28.723791 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c837fd2e-c3be-4ede-8cee-65a1610f2ccc tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:17:29.349633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-edbb57ce-5551-4bb6-88cc-ab1c40a1c6c8-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:17:29.368141 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-edbb57ce-5551-4bb6-88cc-ab1c40a1c6c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:17:29.370430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:42.423527 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:17:49.278473 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:17:49.325719 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Flow 'volume_create_manager' (1216b8f5-8f38-4988-9fdf-a45c22d366e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:17:49.332926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a250fb3-5862-4cd4-96fe-22d4358195f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.347044 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=40,cinder:UPDATE=7,cinder:INSERT=29,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:17:49.355687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a250fb3-5862-4cd4-96fe-22d4358195f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-173814877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff560bff-444b-423b-acb9-c5f910eaffd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31344940c49d48e7a73a474b7ba778b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:17:49Z,use_quota=True,user_id='26d0055806e642de86caa8f715cee5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ae84bd4-f9d6-45f4-92d8-5a2a1f331787),volume_type_id=5ae84bd4-f9d6-45f4-92d8-5a2a1f331787)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.362202 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d505220d-ac8f-4a6b-ba0c-f97508535aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.367112 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d505220d-ac8f-4a6b-ba0c-f97508535aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.373933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a793997-6a9c-46ed-9881-7550ebf419a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.378225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a793997-6a9c-46ed-9881-7550ebf419a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff560bff-444b-423b-acb9-c5f910eaffd2', 'volume_name': 'volume-ff560bff-444b-423b-acb9-c5f910eaffd2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.388077 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40958189-41ed-43eb-9f34-acde1719e308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.395526 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40958189-41ed-43eb-9f34-acde1719e308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.400336 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92964eac-8cee-44f9-aae3-e4703735bac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.401685 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Volume ff560bff-444b-423b-acb9-c5f910eaffd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff560bff-444b-423b-acb9-c5f910eaffd2', 'volume_size': 1}
Oct 08 21:17:49.402105 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] creating volume 'volume-ff560bff-444b-423b-acb9-c5f910eaffd2' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:17:49.403704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:49.497909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:17:49.499513 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:17:49.505175 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92964eac-8cee-44f9-aae3-e4703735bac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff560bff-444b-423b-acb9-c5f910eaffd2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.510114 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea3301-012e-4714-aa6b-8997efa0992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:17:49.526253 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Volume volume-ff560bff-444b-423b-acb9-c5f910eaffd2 (ff560bff-444b-423b-acb9-c5f910eaffd2): created successfully
Oct 08 21:17:49.538896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea3301-012e-4714-aa6b-8997efa0992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:17:49.551310 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Flow 'volume_create_manager' (1216b8f5-8f38-4988-9fdf-a45c22d366e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:17:49.564761 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-37874f64-281f-441c-acb8-417f30253e67 tempest-VolumeTypesTest-995525606 None] Created volume successfully.
Oct 08 21:17:50.687980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d112234-b170-46dc-828f-798d6baaaefc tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:50.749047 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d112234-b170-46dc-828f-798d6baaaefc tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:50.814268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-3d112234-b170-46dc-828f-798d6baaaefc tempest-VolumeTypesTest-995525606 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:17:50.819517 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3d112234-b170-46dc-828f-798d6baaaefc tempest-VolumeTypesTest-995525606 None] Retype volume completed successfully.
Oct 08 21:17:53.439858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Acquiring lock "cinder-ff560bff-444b-423b-acb9-c5f910eaffd2-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:17:53.459398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Lock "cinder-ff560bff-444b-423b-acb9-c5f910eaffd2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:17:53.506748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:53.602238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:17:53.602741 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Volume volume-ff560bff-444b-423b-acb9-c5f910eaffd2 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:17:53.615688 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] deleting rbd volume volume-ff560bff-444b-423b-acb9-c5f910eaffd2 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:17:53.958826 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-82327955 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-82327955, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:17:53.961595 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-82327955 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-82327955, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:17:53.981358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Created reservations ['89fdaeda-5d24-4527-8239-0bef3aa59453', 'e6c7cd2f-6152-4d5a-bcc9-1536263c2207', '8a4ef766-deb9-4d22-909a-e557adb088b3', '911d1dea-867b-41ba-bdb0-2013a3979398'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:17:54.057555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:54.107061 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:17:54.173989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:17:54.180314 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Deleted volume successfully.
Oct 08 21:17:54.196713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-be69def7-9eb5-43cc-a125-589df9aa3e27 tempest-VolumeTypesTest-995525606 None] Lock "cinder-ff560bff-444b-423b-acb9-c5f910eaffd2-delete_volume" released by "delete_volume" :: held 0.737s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:17:59.683358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['8c221162-deb0-4d08-80b5-c079ed4158f1', '3ff2b824-17f6-4d4f-8084-1fde36ef1b2c', 'e231cc32-d1af-480f-a20b-0ed9e8f8f10d', '23e439ee-c48c-464b-813d-0a6394f00c70'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:17:59.749775 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:17:59.756054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a4ddb63-ec8b-44ba-9aeb-d21e6e084f93 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-edbb57ce-5551-4bb6-88cc-ab1c40a1c6c8-delete_snapshot" released by "delete_snapshot" :: held 30.389s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:18:00.273287 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-6cdb5263-b459-4f3e-90b1-47829af5a379-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:00.290554 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-6cdb5263-b459-4f3e-90b1-47829af5a379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:00.296043 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:00.430185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:00.458177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Flow 'volume_create_manager' (9c34f1ce-6c1f-4854-a5f7-360c21be9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:00.468072 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fed27ce-85ee-402c-a06a-44b2e1a1b592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.503373 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fed27ce-85ee-402c-a06a-44b2e1a1b592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1952973824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d59e4e72-71c8-4278-b0a8-26c711325c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bca313139748f5bb1ac87e3406c094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:00Z,use_quota=True,user_id='748f001bf6324a98bf625a8e71bb7d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.510991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c5dfe-e8a6-4ca5-a621-8e8511f7477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.516121 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c5dfe-e8a6-4ca5-a621-8e8511f7477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.522783 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33aa1cc4-a759-4ce6-9783-1ecffa5d332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.527312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33aa1cc4-a759-4ce6-9783-1ecffa5d332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59e4e72-71c8-4278-b0a8-26c711325c48', 'volume_name': 'volume-d59e4e72-71c8-4278-b0a8-26c711325c48', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.533569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a06091-be05-4348-a384-e859b0bd570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.537792 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a06091-be05-4348-a384-e859b0bd570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.543180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40daaf4-24bb-4cca-830c-71e3b28364e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.544345 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Volume d59e4e72-71c8-4278-b0a8-26c711325c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59e4e72-71c8-4278-b0a8-26c711325c48', 'volume_size': 1}
Oct 08 21:18:00.545443 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] creating volume 'volume-d59e4e72-71c8-4278-b0a8-26c711325c48' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:00.546384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:00.645346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:00.645850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:00.652376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40daaf4-24bb-4cca-830c-71e3b28364e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59e4e72-71c8-4278-b0a8-26c711325c48', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.659190 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22976f-9503-4923-a6ad-027b20d13e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:00.673691 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Volume volume-d59e4e72-71c8-4278-b0a8-26c711325c48 (d59e4e72-71c8-4278-b0a8-26c711325c48): created successfully
Oct 08 21:18:00.677595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22976f-9503-4923-a6ad-027b20d13e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:00.687817 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Flow 'volume_create_manager' (9c34f1ce-6c1f-4854-a5f7-360c21be9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:00.700552 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e1be8fe7-e4cc-4ed9-a256-3b8eadd02396 tempest-AbsoluteLimitsTests-349785869 None] Created volume successfully.
Oct 08 21:18:01.569137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Acquiring lock "cinder-d59e4e72-71c8-4278-b0a8-26c711325c48-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:01.610347 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Lock "cinder-d59e4e72-71c8-4278-b0a8-26c711325c48-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:01.741756 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:01.842587 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:01.843151 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Volume volume-d59e4e72-71c8-4278-b0a8-26c711325c48 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:01.852645 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] deleting rbd volume volume-d59e4e72-71c8-4278-b0a8-26c711325c48 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:02.228414 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Created reservations ['417dda1f-0508-48c4-927c-2da68cdac845', '3148c253-5b66-4272-9a32-7063d159e56f', 'da5bcd18-1946-47ec-8871-66dcd3c06f02', '09b1e378-2240-44d9-9afa-b21d7282fdd0'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:02.326304 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:02.394906 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:02.458078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:02.466505 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Deleted volume successfully.
Oct 08 21:18:02.468686 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=56,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:02.533220 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f825a3ac-68ca-49f5-b5f2-387b00db8d3f tempest-AbsoluteLimitsTests-349785869 None] Lock "cinder-d59e4e72-71c8-4278-b0a8-26c711325c48-delete_volume" released by "delete_volume" :: held 0.923s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:18:05.950297 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:18:05.953316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:06.012772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:06.095861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:09.085600 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ed6098ae-3a0d-490d-9412-9ec6547b513f tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-1357473542: creating
Oct 08 21:18:09.106595 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ed6098ae-3a0d-490d-9412-9ec6547b513f tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-1357473542: created successfully
Oct 08 21:18:09.117722 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ed6098ae-3a0d-490d-9412-9ec6547b513f tempest-GroupSnapshotsTest-2022666030 None] Create group completed successfully.
Oct 08 21:18:09.319234 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:09.342056 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Flow 'volume_create_manager' (fd100467-9bf6-4f24-aee3-06297c8a8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:09.348027 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d6c095-e8e2-45c5-b962-f3f640e2cda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.365730 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d6c095-e8e2-45c5-b962-f3f640e2cda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1416034680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e8fbf829e45416b8d40ff3a9e512fe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:09Z,use_quota=True,user_id='0405dc39ca524c87ae5a99db8d85e615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.371172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0463675a-817d-4571-aacd-cf5e7c61647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.375359 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0463675a-817d-4571-aacd-cf5e7c61647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.380421 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e24756-7f36-4d58-a4c9-4b0de5f3a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.384572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e24756-7f36-4d58-a4c9-4b0de5f3a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad', 'volume_name': 'volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.390033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c3b053-bca8-4579-a6aa-d7c69e0c0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.394008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c3b053-bca8-4579-a6aa-d7c69e0c0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.398642 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de44cc6-ac1f-46f2-942f-f3285c03aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.399818 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Volume 6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad', 'volume_size': 1}
Oct 08 21:18:09.400262 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] creating volume 'volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:09.401309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:09.485721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:09.486172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:09.490983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de44cc6-ac1f-46f2-942f-f3285c03aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.496865 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9332c3-0fad-4fe4-8a5e-128f2d896858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:09.512395 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Volume volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad (6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad): created successfully
Oct 08 21:18:09.525078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9332c3-0fad-4fe4-8a5e-128f2d896858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:09.534852 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Flow 'volume_create_manager' (fd100467-9bf6-4f24-aee3-06297c8a8d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:09.555185 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-be880740-f65d-4381-83c3-bf20d1b38e35 tempest-VolumesNegativeTest-1526929498 None] Created volume successfully.
Oct 08 21:18:10.713653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:10.734072 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (adbf9d22-a7fd-48ab-a0d3-72246d2758b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:10.740543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f755a8b-1839-452d-bf76-e3e51833d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.757668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f755a8b-1839-452d-bf76-e3e51833d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-750549083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=168747d9-9906-4261-b9b9-aaf696d0b078,host='ncdv-master-1@ceph#ceph',id=9ec608a2-3dbb-4104-9c3a-9f89a5537c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1abce050a4cbcaf6f838d4abfa728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:11Z,use_quota=True,user_id='c82cfdffdac24d0ba847681ad82a2928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8df817c0-1aff-4953-af07-f37e9de31fc9),volume_type_id=8df817c0-1aff-4953-af07-f37e9de31fc9)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.765141 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4237ad4-17c6-434f-b4d4-51da85f7fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.772249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4237ad4-17c6-434f-b4d4-51da85f7fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.779998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dc965d-9e69-4293-821a-5d1ae1ca964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.785161 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dc965d-9e69-4293-821a-5d1ae1ca964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec608a2-3dbb-4104-9c3a-9f89a5537c5c', 'volume_name': 'volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.792109 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4e266b-71a2-4b5e-8602-348e198ac1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.797387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4e266b-71a2-4b5e-8602-348e198ac1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.802773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77410f1-d901-4a76-bc57-fe2a8729c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.804107 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Volume 9ec608a2-3dbb-4104-9c3a-9f89a5537c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c', 'volume_size': 1}
Oct 08 21:18:10.804576 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] creating volume 'volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:10.805328 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:10.886894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:10.887268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:10.891469 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77410f1-d901-4a76-bc57-fe2a8729c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.896191 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5124ce06-aee9-414e-8b19-f6eb1d147e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:10.907924 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c (9ec608a2-3dbb-4104-9c3a-9f89a5537c5c): created successfully
Oct 08 21:18:10.911854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5124ce06-aee9-414e-8b19-f6eb1d147e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:10.918369 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (adbf9d22-a7fd-48ab-a0d3-72246d2758b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:10.929285 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e96b2a98-b9cf-4142-a046-1578b03e6ab3 tempest-GroupSnapshotsTest-2022666030 None] Created volume successfully.
Oct 08 21:18:10.933034 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=65,cinder:DELETE=2,cinder:UPDATE=28,cinder:INSERT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:12.146601 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-07317538-e0fe-492c-9391-95d279db0d37 tempest-GroupSnapshotsTest-2022666030 None] GroupSnapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: creating.
Oct 08 21:18:12.209367 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-07317538-e0fe-492c-9391-95d279db0d37 tempest-GroupSnapshotsTest-2022666030 None] Group snapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: creating. {{(pid=133344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 08 21:18:12.258640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-07317538-e0fe-492c-9391-95d279db0d37 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:12.961081 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-07317538-e0fe-492c-9391-95d279db0d37 tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: created successfully
Oct 08 21:18:14.064549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] cloning volumes/volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c@snapshot-98805f15-fa4c-4f62-b0b4-211b017f7131 to volume-33ff4da6-df85-4463-a1ca-deddee1c1e80 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:18:14.074480 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:14.154879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:14.328748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:14.329130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:14.401492 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-00994248-d3b6-4bd9-acf6-fe5f6b5b3323 tempest-GroupSnapshotsTest-2022666030 None] Create group from source-snapshot-7f981cec-ea88-417f-8a83-af07ad8c62bc completed successfully.
Oct 08 21:18:15.769102 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:15.861974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:15.870819 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] deleting rbd volume volume-33ff4da6-df85-4463-a1ca-deddee1c1e80 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:16.224770 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['6b54013d-b38e-451c-871d-2f3f3cce1c3e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:16.267630 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-569857168 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-569857168, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:16.268563 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-569857168 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-569857168, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:16.287905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['89d47e5c-ad65-48d2-8835-58043ef41405', '5459f394-9920-4dce-b3f9-1d58062bdde0', '00f9d4b6-7c80-4c3a-bfe8-16dc8e58d70f', '59910bed-02fc-4bd2-8322-604ea9882e4a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:16.437658 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:16.508583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:16.568379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:16.573804 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-59baa4f4-aa76-484b-971a-caa5cbac30a1 tempest-GroupSnapshotsTest-2022666030 None] Delete group completed successfully.
Oct 08 21:18:16.988959 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: deleting
Oct 08 21:18:17.011461 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: deleting {{(pid=133344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 08 21:18:17.038187 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:17.936325 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-569857168 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-569857168, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:17.955538 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['217a5184-4dd9-4b90-8aeb-a013060bd1ac', '3a9240e1-fe1d-4d0a-a14d-4e6a5e4cd1e0', '6b6895e3-f589-450a-a7cb-83f27d52cc33', '10e686c7-f9d7-4984-a967-15380344918f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:18.016886 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-03a2feac-0a54-400b-b924-56e07a68e951 tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 7f981cec-ea88-417f-8a83-af07ad8c62bc: deleted successfully
Oct 08 21:18:18.538003 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:18.592288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:18.592786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:18.596620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] deleting rbd volume volume-9ec608a2-3dbb-4104-9c3a-9f89a5537c5c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:18.786039 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:18.799427 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=74,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:18.817786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['caa05763-a32f-4dc4-bdb9-f61130a166ff'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:18.856841 ncdv-master-1 cinder-volume[133344]: WARNING cinder.db.sqlalchemy.api [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-569857168']
Oct 08 21:18:18.860891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['504c8cab-c6bc-4fae-83d1-4303fd508ee0', 'ab9a4c0b-f3e8-4d48-ac39-67cb3c0c0718', '8ad8874f-53c9-44aa-83cb-eac0d3ecc59d', 'c8cd7786-c98a-43ab-8eca-cb98aad5447d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:18.954542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:18.997220 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:19.075694 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:19.086560 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-316a7aee-950a-43e5-9c20-7d431c41bf60 tempest-GroupSnapshotsTest-2022666030 None] Delete group completed successfully.
Oct 08 21:18:19.935864 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a96116e4-0a3b-4bce-ba70-d97214338251 tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-1120853969: creating
Oct 08 21:18:19.955434 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a96116e4-0a3b-4bce-ba70-d97214338251 tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-1120853969: created successfully
Oct 08 21:18:19.967515 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a96116e4-0a3b-4bce-ba70-d97214338251 tempest-GroupSnapshotsTest-2022666030 None] Create group completed successfully.
Oct 08 21:18:21.587916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:21.614631 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (5a34e32e-652f-4c37-a240-22f314c48d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:21.621696 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbea893d-cc05-4bec-b1e2-20556a4e42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.642421 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbea893d-cc05-4bec-b1e2-20556a4e42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1915861450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63955f6b-bfc2-4fb7-b05f-24f89a797b66,host='ncdv-master-1@ceph#ceph',id=d515285e-b77b-4344-8923-efeb7db0125c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1abce050a4cbcaf6f838d4abfa728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:22Z,use_quota=True,user_id='c82cfdffdac24d0ba847681ad82a2928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c883638f-6745-4d85-8b14-cbecc7d3b583),volume_type_id=c883638f-6745-4d85-8b14-cbecc7d3b583)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.649322 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c419d5-016e-4984-be6c-aeb26d51bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.657659 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c419d5-016e-4984-be6c-aeb26d51bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.665263 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a49e33-6174-4daa-adf2-c68de895edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.670686 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a49e33-6174-4daa-adf2-c68de895edc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd515285e-b77b-4344-8923-efeb7db0125c', 'volume_name': 'volume-d515285e-b77b-4344-8923-efeb7db0125c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.676320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d548fb35-dca2-446d-83ad-f39747ddd494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.682284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d548fb35-dca2-446d-83ad-f39747ddd494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.688054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a71b13-3312-494d-a589-ea76fde3a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.689578 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Volume d515285e-b77b-4344-8923-efeb7db0125c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d515285e-b77b-4344-8923-efeb7db0125c', 'volume_size': 1}
Oct 08 21:18:21.690222 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] creating volume 'volume-d515285e-b77b-4344-8923-efeb7db0125c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:21.691201 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:21.795076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:21.795459 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:21.800478 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a71b13-3312-494d-a589-ea76fde3a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d515285e-b77b-4344-8923-efeb7db0125c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.805895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38d8cc4-1332-4481-bb2b-39450d15b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:21.819707 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-d515285e-b77b-4344-8923-efeb7db0125c (d515285e-b77b-4344-8923-efeb7db0125c): created successfully
Oct 08 21:18:21.823861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38d8cc4-1332-4481-bb2b-39450d15b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:21.829881 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (5a34e32e-652f-4c37-a240-22f314c48d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:21.841419 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-accbe7ac-bc6e-4772-89d1-42a28f3d4023 tempest-GroupSnapshotsTest-2022666030 None] Created volume successfully.
Oct 08 21:18:23.256358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:23.311769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (6effceb8-1d4a-4c55-9ce8-fc28292f503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:23.322103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148b8081-5906-4750-89e4-3a15b11243b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.340578 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148b8081-5906-4750-89e4-3a15b11243b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-34582430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63955f6b-bfc2-4fb7-b05f-24f89a797b66,host='ncdv-master-1@ceph#ceph',id=a20c03d1-d34e-4d67-81ca-29ca00963ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1abce050a4cbcaf6f838d4abfa728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:23Z,use_quota=True,user_id='c82cfdffdac24d0ba847681ad82a2928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c883638f-6745-4d85-8b14-cbecc7d3b583),volume_type_id=c883638f-6745-4d85-8b14-cbecc7d3b583)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.346015 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0916f2fc-672a-4cfc-9fdc-2877c6696a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.352546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0916f2fc-672a-4cfc-9fdc-2877c6696a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.355360 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5f1677-06ad-4d01-9686-5c8f77c80db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.359785 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5f1677-06ad-4d01-9686-5c8f77c80db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20c03d1-d34e-4d67-81ca-29ca00963ecf', 'volume_name': 'volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.364540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070d5405-d5ed-4e70-afd5-e5611092cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.368475 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070d5405-d5ed-4e70-afd5-e5611092cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.373732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460cc814-5f3a-4a0a-8c10-cf91079ecebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.375034 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Volume a20c03d1-d34e-4d67-81ca-29ca00963ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf', 'volume_size': 1}
Oct 08 21:18:23.375643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] creating volume 'volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:23.376299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:23.468187 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:23.468666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:23.473097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460cc814-5f3a-4a0a-8c10-cf91079ecebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.478437 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740dee20-ef9c-4eb2-954d-6f4bc8af4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.496050 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf (a20c03d1-d34e-4d67-81ca-29ca00963ecf): created successfully
Oct 08 21:18:23.501655 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740dee20-ef9c-4eb2-954d-6f4bc8af4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.508801 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (6effceb8-1d4a-4c55-9ce8-fc28292f503a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:23.534234 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fc020221-bd92-41d6-b88d-26117f679553 tempest-GroupSnapshotsTest-2022666030 None] Created volume successfully.
Oct 08 21:18:23.619626 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:23.639500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (d0704b34-d661-4d7b-8331-4ebf5660349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:23.645681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fe8d38-de16-4d1e-9f86-a02864b505a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.663226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fe8d38-de16-4d1e-9f86-a02864b505a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-983185199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=846bd1eb-e484-4b7e-aa01-8cf22106cec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d29b90ab34abbadd21edbca637d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:24Z,use_quota=True,user_id='8957041987c8487099f0d89f4c64af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.669679 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdcf365-7c50-494c-9f4d-c53332d028a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.673927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdcf365-7c50-494c-9f4d-c53332d028a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.678882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc361985-5839-4cde-8809-b27e42581564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.682897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc361985-5839-4cde-8809-b27e42581564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'volume_name': 'volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.688455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58c826a-8a82-4fc3-a8d6-d3432cea2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.692683 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58c826a-8a82-4fc3-a8d6-d3432cea2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.697291 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4ad46a-11a9-465f-b4c9-2f17c3c2e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.698349 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Volume 846bd1eb-e484-4b7e-aa01-8cf22106cec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'volume_size': 1}
Oct 08 21:18:23.698891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] creating volume 'volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:23.699528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:23.765381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:23.765758 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:23.769463 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4ad46a-11a9-465f-b4c9-2f17c3c2e80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.774063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b511e0-85cb-4c22-bf14-0dafb34fd844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:23.783272 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3 (846bd1eb-e484-4b7e-aa01-8cf22106cec3): created successfully
Oct 08 21:18:23.786860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b511e0-85cb-4c22-bf14-0dafb34fd844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:23.792310 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (d0704b34-d661-4d7b-8331-4ebf5660349f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:23.801356 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c541a5cf-2a09-46c9-aa50-85997692aba1 tempest-AttachVolumeNegativeTest-1956575659 None] Created volume successfully.
Oct 08 21:18:24.467656 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e04f1eb9-5db7-436c-a681-8d5b9f911661 tempest-GroupSnapshotsTest-2022666030 None] Update group completed successfully.
Oct 08 21:18:25.197426 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-6bbf01d7-403f-49ae-97eb-ebba97e355cc req-063ddb38-5541-4b82-8b8d-3acebd754895 tempest-AttachVolumeNegativeTest-1956575659 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:18:25.719504 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c9365bab-9c39-4769-adab-0aa2abcf6792 tempest-GroupSnapshotsTest-2022666030 None] Update group completed successfully.
Oct 08 21:18:26.033657 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-6bbf01d7-403f-49ae-97eb-ebba97e355cc req-063ddb38-5541-4b82-8b8d-3acebd754895 tempest-AttachVolumeNegativeTest-1956575659 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.837s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:18:26.034600 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-6bbf01d7-403f-49ae-97eb-ebba97e355cc req-063ddb38-5541-4b82-8b8d-3acebd754895 tempest-AttachVolumeNegativeTest-1956575659 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:18:26.058484 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-6bbf01d7-403f-49ae-97eb-ebba97e355cc req-063ddb38-5541-4b82-8b8d-3acebd754895 tempest-AttachVolumeNegativeTest-1956575659 None] Connection info returned from driver {'name': 'volumes/volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '846bd1eb-e484-4b7e-aa01-8cf22106cec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '58b08584-c256-41f6-97d6-270d66a7b6e9'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:18:26.129415 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-6bbf01d7-403f-49ae-97eb-ebba97e355cc req-063ddb38-5541-4b82-8b8d-3acebd754895 tempest-AttachVolumeNegativeTest-1956575659 None] attachment_update completed successfully.
Oct 08 21:18:26.833713 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a133b269-e42e-40be-90f9-1f27c3c443ca tempest-GroupSnapshotsTest-2022666030 None] Update group completed successfully.
Oct 08 21:18:28.060884 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d6c967a5-cefe-413c-a101-7c14f9983be1 tempest-GroupSnapshotsTest-2022666030 None] Update group completed successfully.
Oct 08 21:18:29.442622 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-7be17418-3f54-40f7-aba6-1e234db6c2a3 req-5579e41e-9c91-4463-a044-f29b62240307 tempest-AttachVolumeNegativeTest-1956575659 None] Terminate volume connection completed successfully.
Oct 08 21:18:29.443316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-7be17418-3f54-40f7-aba6-1e234db6c2a3 req-5579e41e-9c91-4463-a044-f29b62240307 tempest-AttachVolumeNegativeTest-1956575659 None] Deleting attachment 58b08584-c256-41f6-97d6-270d66a7b6e9. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:18:29.534865 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f6821752-e0a4-4590-91db-a1a36ac25f0b tempest-GroupSnapshotsTest-2022666030 None] GroupSnapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: creating.
Oct 08 21:18:29.595861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f6821752-e0a4-4590-91db-a1a36ac25f0b tempest-GroupSnapshotsTest-2022666030 None] Group snapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: creating. {{(pid=133344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 08 21:18:29.630672 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f6821752-e0a4-4590-91db-a1a36ac25f0b tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:30.058626 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f6821752-e0a4-4590-91db-a1a36ac25f0b tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:30.547901 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=71,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:30.559071 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['709ca26f-26c7-493e-b7ff-10a2632bfab0', 'fe1ba612-a107-4429-b2b4-4a195590e86c', '29fb3cb1-fbda-472a-8d65-7648b545a588', '94ea4984-4c8c-437b-9033-51d7d5bdad7e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:30.567189 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=76,cinder:INSERT=5,cinder:UPDATE=19 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:30.641177 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:18:30.647919 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-e3f4bdc6-695e-43ce-853d-4bb60822cc6c tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-6cdb5263-b459-4f3e-90b1-47829af5a379-delete_snapshot" released by "delete_snapshot" :: held 30.357s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:18:30.720254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-543f2821-ed3d-42fb-a8e0-e819eec88f80-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:30.754615 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-543f2821-ed3d-42fb-a8e0-e819eec88f80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:30.757091 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:31.240672 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f6821752-e0a4-4590-91db-a1a36ac25f0b tempest-GroupSnapshotsTest-2022666030 None] group_snapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: created successfully
Oct 08 21:18:31.991922 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] group_snapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: deleting
Oct 08 21:18:32.038592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] group_snapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: deleting {{(pid=133344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 08 21:18:32.078947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:33.117718 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:33.920226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Acquiring lock "cinder-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:33.930547 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Lock "cinder-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:34.034390 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:34.126458 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:34.127029 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Volume volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:34.135589 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] deleting rbd volume volume-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:34.268161 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1896089599 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1896089599, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:34.269444 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1896089599 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1896089599, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:34.289760 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['df335197-2c04-4890-9372-09e8a57c7217', '8e99a081-1167-422e-a77b-7795edc9d2b7', '3670cf48-a280-4f0f-98e2-05acc4e6ca83', 'e6c2fcb9-6f43-46b5-9ee2-f3e27c3a9665'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:34.425396 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['2e9a444b-2233-4b33-89db-61c04527033a', '98df7cd5-1a74-4168-9ae0-9e1d7ba9b210', '6a27c2b9-b5b3-43b3-a9ed-aec805415516', '9ed56492-bd27-4c67-b095-15a50c54276d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:34.533776 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c1c46adf-c577-4b08-b5b4-fe6be6edbb2e tempest-GroupSnapshotsTest-2022666030 None] group_snapshot cec9e0ec-5f3a-46b8-99ba-594835d22263: deleted successfully
Oct 08 21:18:34.539035 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Created reservations ['4565c0a2-7db4-45a1-9ca7-d9e292731640', 'b77dbe8d-7cdb-447a-b7f6-32967e32a477', 'cb915be1-5867-4178-890b-b7935d41406c', '051ed92a-469d-495a-84fd-e35acde687c9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:34.592697 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:34.634053 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:34.672375 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:34.676145 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Deleted volume successfully.
Oct 08 21:18:34.691741 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2f23dce7-1d60-4f71-a0ad-4a4eb31ec080 tempest-VolumesNegativeTest-1526929498 None] Lock "cinder-6634a6bc-e0d0-4fd6-aa76-8d1903ea60ad-delete_volume" released by "delete_volume" :: held 0.761s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:18:35.915003 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:36.037594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:36.038124 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Volume volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:36.046048 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] deleting rbd volume volume-a20c03d1-d34e-4d67-81ca-29ca00963ecf {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:36.298530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:36.389699 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:36.389699 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Volume volume-d515285e-b77b-4344-8923-efeb7db0125c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:36.402171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] deleting rbd volume volume-d515285e-b77b-4344-8923-efeb7db0125c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:36.737249 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=32,cinder:INSERT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:36.875059 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['f6cd6ac4-7a20-4e75-be93-33ac5a3d26d9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:36.916495 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1896089599 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1896089599, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:36.956923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['fefdeaf3-8875-4ab5-8269-c541ae274af8', 'bdda6b15-2438-4e05-a9e9-6cec545aaa32', 'b7ecbdae-65c8-4fd9-bcc7-e3fab025e2a6', 'e31c3fa3-7519-4d79-8114-855fa00fce0b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:37.069016 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:37.238348 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['12a0d8a7-77db-4681-9e43-9f80b4dce706', 'ff253762-b8ab-4151-b284-c0213e96ed2e', '99a1a0f5-9e1a-4f54-bb72-0b3968cbafcf', '72d50219-4ca5-430f-9e4e-198a5a288531'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:37.362577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:37.447495 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:37.517701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:37.530513 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c070ff79-1910-4119-a7d5-d72ea63dbb4d tempest-GroupSnapshotsTest-2022666030 None] Delete group completed successfully.
Oct 08 21:18:38.913147 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d9606594-af9b-41e6-a173-56fbb4174b21 tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-631287597: creating
Oct 08 21:18:38.944939 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d9606594-af9b-41e6-a173-56fbb4174b21 tempest-GroupSnapshotsTest-2022666030 None] Group tempest-GroupSnapshotsTest-Group-631287597: created successfully
Oct 08 21:18:38.956265 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d9606594-af9b-41e6-a173-56fbb4174b21 tempest-GroupSnapshotsTest-2022666030 None] Create group completed successfully.
Oct 08 21:18:40.796637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:40.827818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (5f6f18de-f94f-4efe-88d2-0b013a960059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:40.844773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9811ac-2a04-4f30-bc4b-a89a7b364695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:40.863947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9811ac-2a04-4f30-bc4b-a89a7b364695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1113670285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=245f362d-6f59-4b0e-a333-e2e5e65ed418,host='ncdv-master-1@ceph#ceph',id=32bdbffb-7846-47e1-937e-006dd89f9c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1abce050a4cbcaf6f838d4abfa728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:41Z,use_quota=True,user_id='c82cfdffdac24d0ba847681ad82a2928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88ff3c78-5638-4b1c-ae31-b7a94f7aea45),volume_type_id=88ff3c78-5638-4b1c-ae31-b7a94f7aea45)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:40.870513 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b2052-68b7-4978-9b84-f821d5045a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:40.875503 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b2052-68b7-4978-9b84-f821d5045a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:40.881734 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644c015c-b3fd-4208-bbf0-153de4176afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:40.897605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644c015c-b3fd-4208-bbf0-153de4176afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bdbffb-7846-47e1-937e-006dd89f9c3f', 'volume_name': 'volume-32bdbffb-7846-47e1-937e-006dd89f9c3f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:40.902907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f722a89b-769e-4cd8-8035-e4550f30bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:40.908461 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f722a89b-769e-4cd8-8035-e4550f30bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:40.919907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e62e9e8-7b2e-4d20-9543-249673bf7afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:40.939197 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Volume 32bdbffb-7846-47e1-937e-006dd89f9c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bdbffb-7846-47e1-937e-006dd89f9c3f', 'volume_size': 1}
Oct 08 21:18:40.941764 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] creating volume 'volume-32bdbffb-7846-47e1-937e-006dd89f9c3f' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:40.942728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:41.055812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:41.056344 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:41.061762 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e62e9e8-7b2e-4d20-9543-249673bf7afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bdbffb-7846-47e1-937e-006dd89f9c3f', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:41.067938 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856bdb93-d10e-45d5-95bd-7fc4cd22a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:41.080754 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-32bdbffb-7846-47e1-937e-006dd89f9c3f (32bdbffb-7846-47e1-937e-006dd89f9c3f): created successfully
Oct 08 21:18:41.085566 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856bdb93-d10e-45d5-95bd-7fc4cd22a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:41.094098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Flow 'volume_create_manager' (5f6f18de-f94f-4efe-88d2-0b013a960059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:41.107030 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-929b2ce8-eaeb-439b-b5de-39b1ba8a2725 tempest-GroupSnapshotsTest-2022666030 None] Created volume successfully.
Oct 08 21:18:42.128007 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-54ae69c7-81b2-4606-ad12-aba1040b8edd tempest-GroupSnapshotsTest-2022666030 None] GroupSnapshot 3074067e-1e56-4080-b565-1906a6b9e202: creating.
Oct 08 21:18:42.167343 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-54ae69c7-81b2-4606-ad12-aba1040b8edd tempest-GroupSnapshotsTest-2022666030 None] Group snapshot 3074067e-1e56-4080-b565-1906a6b9e202: creating. {{(pid=133344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 08 21:18:42.206554 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-54ae69c7-81b2-4606-ad12-aba1040b8edd tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:42.992418 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-54ae69c7-81b2-4606-ad12-aba1040b8edd tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 3074067e-1e56-4080-b565-1906a6b9e202: created successfully
Oct 08 21:18:43.615808 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 3074067e-1e56-4080-b565-1906a6b9e202: deleting
Oct 08 21:18:43.650951 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 3074067e-1e56-4080-b565-1906a6b9e202: deleting {{(pid=133344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 08 21:18:43.717552 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:45.088246 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1646671109 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1646671109, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:45.097793 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1646671109 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1646671109, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:45.122492 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['250f4bd1-2bc2-4ebb-b934-77f32b7108fd', 'd942299c-88d4-4059-aeff-6909adfed168', '9ad4c6a6-c552-44e0-884b-14aef4b0f5db', '32fc45f1-9fa8-477a-8c77-2be2a6ef9dea'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:45.217758 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8534f11e-a591-4195-a8ea-dd5269fb3aeb tempest-GroupSnapshotsTest-2022666030 None] group_snapshot 3074067e-1e56-4080-b565-1906a6b9e202: deleted successfully
Oct 08 21:18:46.689283 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=34,cinder:INSERT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:46.823546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:46.938294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:46.938722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Volume volume-32bdbffb-7846-47e1-937e-006dd89f9c3f is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:46.947174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] deleting rbd volume volume-32bdbffb-7846-47e1-937e-006dd89f9c3f {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:47.366180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['1eaec0ee-1eb7-4f81-9c62-af4a3b3647ba'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:47.404596 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1646671109 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1646671109, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:18:47.440661 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Created reservations ['fb9c0ff0-5b99-4369-9130-e516183ca1d1', '8c1925ed-c983-4c44-b867-cf9473a0b8e6', '62718be4-ca91-42f6-973d-cab9a1a210ab', '44afdd37-1949-4593-938d-a0d33a0c5718'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:47.592149 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:18:47.676787 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:47.774652 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:47.874061 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:47.879350 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3044f7d0-3327-4d5b-a42d-870e29084d49 tempest-GroupSnapshotsTest-2022666030 None] Delete group completed successfully.
Oct 08 21:18:48.295081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:48.324455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Flow 'volume_create_manager' (98cc8d7e-e873-4d79-9ca5-2d68e29f2d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:48.331111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26af8c38-b54f-45a1-a56b-fb4d3d4565a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.361240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26af8c38-b54f-45a1-a56b-fb4d3d4565a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1404096073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3189441b-9679-4d3f-ac38-8eb4405ff887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28b0a6c5619d46929802ef47ff71127f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:48Z,use_quota=True,user_id='2799e2cc255e45d8becb3c9be42f61c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.373303 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8426a4c5-8e14-4676-bb9b-f6a6a52d0a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.377550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8426a4c5-8e14-4676-bb9b-f6a6a52d0a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.391199 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919a257-6ca9-4714-a43e-426c2b1a68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.396133 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f919a257-6ca9-4714-a43e-426c2b1a68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3189441b-9679-4d3f-ac38-8eb4405ff887', 'volume_name': 'volume-3189441b-9679-4d3f-ac38-8eb4405ff887', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.402624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cbe63f-8648-4277-b895-6380830d1307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.407618 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cbe63f-8648-4277-b895-6380830d1307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.413157 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da602d2f-d8e8-4f9e-a2ff-91f13e110b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.414592 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Volume 3189441b-9679-4d3f-ac38-8eb4405ff887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3189441b-9679-4d3f-ac38-8eb4405ff887', 'volume_size': 1}
Oct 08 21:18:48.415138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] creating volume 'volume-3189441b-9679-4d3f-ac38-8eb4405ff887' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:48.416178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:48.530293 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:48.530691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:48.534450 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da602d2f-d8e8-4f9e-a2ff-91f13e110b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3189441b-9679-4d3f-ac38-8eb4405ff887', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.540191 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b98f6e-b1d7-4f44-b2b0-1895bf0cef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:48.592272 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Volume volume-3189441b-9679-4d3f-ac38-8eb4405ff887 (3189441b-9679-4d3f-ac38-8eb4405ff887): created successfully
Oct 08 21:18:48.595837 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b98f6e-b1d7-4f44-b2b0-1895bf0cef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:48.622098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Flow 'volume_create_manager' (98cc8d7e-e873-4d79-9ca5-2d68e29f2d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:48.638929 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-30cc7331-50aa-40b4-9f77-e6718b54a8aa tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Created volume successfully.
Oct 08 21:18:50.498024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Acquiring lock "cinder-3189441b-9679-4d3f-ac38-8eb4405ff887-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:50.526576 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Lock "cinder-3189441b-9679-4d3f-ac38-8eb4405ff887-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:50.577861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:50.691125 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:50.692715 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Volume volume-3189441b-9679-4d3f-ac38-8eb4405ff887 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:50.703136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] deleting rbd volume volume-3189441b-9679-4d3f-ac38-8eb4405ff887 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:18:51.109509 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Created reservations ['ba2ea60a-d1b0-49a2-834b-db4b48301396', '2fda723a-b349-4cef-97bb-14575ac445e0', 'dcd5b4e2-9a6c-4e4a-94cb-9103909c2c85', '1374a15b-e1ff-430d-b974-58bbd351eaac'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:51.191569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:51.268241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:51.348426 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:51.360785 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Deleted volume successfully.
Oct 08 21:18:51.386034 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d194d509-57f5-470d-80d7-cc564c32f7d8 tempest-VolumeQuotasNegativeTestJSON-1344740606 None] Lock "cinder-3189441b-9679-4d3f-ac38-8eb4405ff887-delete_volume" released by "delete_volume" :: held 0.861s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:18:55.896484 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f4ffd941-c16d-4ac2-9729-95e3c158cf23 tempest-GroupsV320Test-907769049 None] Group tempest-GroupsV320Test-Group-1218395450: creating
Oct 08 21:18:55.945368 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f4ffd941-c16d-4ac2-9729-95e3c158cf23 tempest-GroupsV320Test-907769049 None] Group tempest-GroupsV320Test-Group-1218395450: created successfully
Oct 08 21:18:55.970712 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f4ffd941-c16d-4ac2-9729-95e3c158cf23 tempest-GroupsV320Test-907769049 None] Create group completed successfully.
Oct 08 21:18:57.708873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1571366e-2f53-4e94-9b64-30859940dfd0 tempest-GroupsV320Test-907769049 None] Created reservations ['8cbfa3a7-63c1-4610-979d-098811bde4ab'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:18:57.773397 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1571366e-2f53-4e94-9b64-30859940dfd0 tempest-GroupsV320Test-907769049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:57.838719 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1571366e-2f53-4e94-9b64-30859940dfd0 tempest-GroupsV320Test-907769049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:57.905849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1571366e-2f53-4e94-9b64-30859940dfd0 tempest-GroupsV320Test-907769049 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:18:57.918922 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1571366e-2f53-4e94-9b64-30859940dfd0 tempest-GroupsV320Test-907769049 None] Delete group completed successfully.
Oct 08 21:18:58.552429 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:18:58.603728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Flow 'volume_create_manager' (d3801bf0-9ae0-4f99-83f1-1bb6c7e22d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:58.612864 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e270e534-84e2-40e5-be8f-b99848fd408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.634325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e270e534-84e2-40e5-be8f-b99848fd408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1226700619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=267af1fb-d188-4432-959b-4c0fc0d2647b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ea7cbf6a7b4308beae5549b270f971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:18:59Z,use_quota=True,user_id='49bba657d34043c5a9e315ecf287e875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.644188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05d7f4d-be7d-4b96-a52d-1bad3e142c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.652266 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05d7f4d-be7d-4b96-a52d-1bad3e142c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.673967 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dacb54-80ee-4096-9a6e-184df470d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.694241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dacb54-80ee-4096-9a6e-184df470d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267af1fb-d188-4432-959b-4c0fc0d2647b', 'volume_name': 'volume-267af1fb-d188-4432-959b-4c0fc0d2647b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.705364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fee3a4-a876-4f02-ab2c-9733896e65c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.721341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fee3a4-a876-4f02-ab2c-9733896e65c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.732405 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898851e7-5432-4e4b-a5c5-03bd70d2f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.742165 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Volume 267af1fb-d188-4432-959b-4c0fc0d2647b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267af1fb-d188-4432-959b-4c0fc0d2647b', 'volume_size': 1}
Oct 08 21:18:58.742752 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] creating volume 'volume-267af1fb-d188-4432-959b-4c0fc0d2647b' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:18:58.743733 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:58.864135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:18:58.864135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:18:58.867650 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898851e7-5432-4e4b-a5c5-03bd70d2f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267af1fb-d188-4432-959b-4c0fc0d2647b', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.872999 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efec1c0-b9bd-41bf-89be-e40c3a43b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:18:58.913744 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Volume volume-267af1fb-d188-4432-959b-4c0fc0d2647b (267af1fb-d188-4432-959b-4c0fc0d2647b): created successfully
Oct 08 21:18:58.917750 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efec1c0-b9bd-41bf-89be-e40c3a43b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:18:58.923968 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Flow 'volume_create_manager' (d3801bf0-9ae0-4f99-83f1-1bb6c7e22d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:18:58.949595 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-584a6763-9115-4963-91e7-3b8691225326 tempest-VolumesServicesTestJSON-975929279 None] Created volume successfully.
Oct 08 21:18:59.670915 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Acquiring lock "cinder-267af1fb-d188-4432-959b-4c0fc0d2647b-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:18:59.690944 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Lock "cinder-267af1fb-d188-4432-959b-4c0fc0d2647b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:18:59.755448 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:18:59.837303 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:18:59.837913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Volume volume-267af1fb-d188-4432-959b-4c0fc0d2647b is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:18:59.850240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] deleting rbd volume volume-267af1fb-d188-4432-959b-4c0fc0d2647b {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:00.096872 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Created reservations ['c96dcc89-a8ce-494e-b945-1844e1b01ec3', '93f7d202-895c-409d-a97c-469e73c807f1', '4d9e5f8d-0c57-46b9-b189-9a2c8132184d', '0c516570-cb67-4f71-841f-dec9e618dc4f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:00.138954 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:00.155490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:00.197214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:00.245169 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:00.253064 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Deleted volume successfully.
Oct 08 21:19:00.266808 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf986383-1b6d-4e72-9b70-7b9b3dd8d4f7 tempest-VolumesServicesTestJSON-975929279 None] Lock "cinder-267af1fb-d188-4432-959b-4c0fc0d2647b-delete_volume" released by "delete_volume" :: held 0.577s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:00.992539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['26f45490-900a-4e9b-8752-4c187b1456c6', '21b5d603-6ce3-4f02-b53c-6785aa2a0162', 'f3cf010d-dba2-48e5-87f2-db091a54fb3f', '56c940b6-57f8-4c7d-8109-40923f907f97'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:01.037615 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=30,cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:01.048525 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:19:01.061265 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b4c10fb0-0051-48a8-b0a2-976f2d0b8d3d tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-543f2821-ed3d-42fb-a8e0-e819eec88f80-delete_snapshot" released by "delete_snapshot" :: held 30.304s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:02.401264 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-78e6f639-3ee7-4d41-9a65-cb66923d8985 req-3a920cc6-1542-46eb-9d26-b774ddd3ee67 tempest-VolumesSnapshotTestJSON-547814895 None] Terminate volume connection completed successfully.
Oct 08 21:19:02.403254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-78e6f639-3ee7-4d41-9a65-cb66923d8985 req-3a920cc6-1542-46eb-9d26-b774ddd3ee67 tempest-VolumesSnapshotTestJSON-547814895 None] Deleting attachment 336c2859-005e-4be3-ad9f-154f1a354da8. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:19:05.951239 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:19:05.952993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:06.004179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:06.091179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:06.592364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:06.613328 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Flow 'volume_create_manager' (bc0e0e46-f197-4cef-9b0e-9cf4c8593d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:06.621315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983987c-88c3-4cc9-8f4b-823063c65445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.640043 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983987c-88c3-4cc9-8f4b-823063c65445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-679120159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d04b3997-c6cb-453d-9534-af0eca0e3e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9f34a3f75d4a89aa479c070da8473b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:07Z,use_quota=True,user_id='b6c2435b9e9b4ce0bdddeb9d8d9d398a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.645512 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7024abae-da14-4101-8f60-580cf37019af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.649994 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7024abae-da14-4101-8f60-580cf37019af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.655697 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75727da-bdbe-4aeb-adad-77657a0a0a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.661179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75727da-bdbe-4aeb-adad-77657a0a0a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04b3997-c6cb-453d-9534-af0eca0e3e0e', 'volume_name': 'volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.666607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca65ff93-f3b1-48a5-88b2-44cc8e989cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.673018 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca65ff93-f3b1-48a5-88b2-44cc8e989cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.678531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c7b472-642c-42d6-9fcf-2e65a48d8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.680191 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Volume d04b3997-c6cb-453d-9534-af0eca0e3e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e', 'volume_size': 1}
Oct 08 21:19:06.680904 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] creating volume 'volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:06.681927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:06.785813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:06.786528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:06.791940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c7b472-642c-42d6-9fcf-2e65a48d8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.797764 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0af3c69-61c1-43d8-8fea-e6132eb519c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:06.812399 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Volume volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e (d04b3997-c6cb-453d-9534-af0eca0e3e0e): created successfully
Oct 08 21:19:06.820033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0af3c69-61c1-43d8-8fea-e6132eb519c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:06.831448 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Flow 'volume_create_manager' (bc0e0e46-f197-4cef-9b0e-9cf4c8593d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:06.845134 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eedfbb03-a5dc-4a34-98cb-33767b776be1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Created volume successfully.
Oct 08 21:19:07.242917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-685044e9-3918-4212-a23e-4b922d002fff tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:08.003961 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-01d90908-6683-4e18-ad7a-473f65aba42c tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:08.135752 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-685044e9-3918-4212-a23e-4b922d002fff tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:19:08.553728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-76445452-5cbf-40f8-8978-641e2f94d79a-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:08.573934 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-76445452-5cbf-40f8-8978-641e2f94d79a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:08.576747 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:09.211509 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['f7b55896-af3c-4ee3-a09d-5c49c5001b18', '8baa4f58-4063-4242-ad89-3927fec27527', '72554d42-ba28-40b3-9b57-65c5f4591238', 'd97fceb6-7a41-421b-8623-41f0c38e148d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:09.236368 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-01d90908-6683-4e18-ad7a-473f65aba42c tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Create snapshot completed successfully
Oct 08 21:19:09.339636 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:19:09.345543 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-384a58bf-b181-442c-b97b-2c2e2e413ea9 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-76445452-5cbf-40f8-8978-641e2f94d79a-delete_snapshot" released by "delete_snapshot" :: held 0.772s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:10.008948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f3195b4e-576b-4674-bb5f-321483e1d24d tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:10.526525 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:10.563503 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Flow 'volume_create_manager' (4d0c6446-ab59-4bc5-b6a1-5934ee219afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:10.584835 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6286a5-ae87-4106-826c-5ae0aff4bcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.607231 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6286a5-ae87-4106-826c-5ae0aff4bcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-590412187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b344029-c084-4a63-9ed9-5dacc7aee11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ebbb0ec7c4a92aa6b857dc95dc620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:10Z,use_quota=True,user_id='41787fb5fc0e4c328f5c42d7ccaa4420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.617776 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812cf46b-f126-415e-a632-8e742f0f200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.623036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812cf46b-f126-415e-a632-8e742f0f200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.628236 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa1a793-47f2-4d25-b605-ab248b44159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.632624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa1a793-47f2-4d25-b605-ab248b44159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b344029-c084-4a63-9ed9-5dacc7aee11d', 'volume_name': 'volume-8b344029-c084-4a63-9ed9-5dacc7aee11d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.638440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59d10f5-5c97-4f5a-a2ee-0ddc03cf3a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.642645 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59d10f5-5c97-4f5a-a2ee-0ddc03cf3a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.647901 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836c7c0f-3615-4b34-8a5f-a1e54259f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.649493 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume 8b344029-c084-4a63-9ed9-5dacc7aee11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b344029-c084-4a63-9ed9-5dacc7aee11d', 'volume_size': 1}
Oct 08 21:19:10.650167 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] creating volume 'volume-8b344029-c084-4a63-9ed9-5dacc7aee11d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:10.651156 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:10.768190 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:10.768818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:10.774957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836c7c0f-3615-4b34-8a5f-a1e54259f583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b344029-c084-4a63-9ed9-5dacc7aee11d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.789144 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865d089f-dba6-4244-b3c6-bf66dfb709b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:10.816082 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume volume-8b344029-c084-4a63-9ed9-5dacc7aee11d (8b344029-c084-4a63-9ed9-5dacc7aee11d): created successfully
Oct 08 21:19:10.824046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865d089f-dba6-4244-b3c6-bf66dfb709b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:10.838192 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Flow 'volume_create_manager' (4d0c6446-ab59-4bc5-b6a1-5934ee219afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:10.860064 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9ee40a50-6102-4f96-a6fb-ff52089c6672 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Created volume successfully.
Oct 08 21:19:10.890450 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Acquiring lock "cinder-96714edb-c581-4437-addf-1e995d417b8a-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:10.909455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Lock "cinder-96714edb-c581-4437-addf-1e995d417b8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:10.909455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:11.142894 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f3195b4e-576b-4674-bb5f-321483e1d24d tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:19:11.689214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Acquiring lock "cinder-8b344029-c084-4a63-9ed9-5dacc7aee11d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:11.713019 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Lock "cinder-8b344029-c084-4a63-9ed9-5dacc7aee11d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:11.857535 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:11.967688 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:11.968235 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume volume-8b344029-c084-4a63-9ed9-5dacc7aee11d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:11.980413 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] deleting rbd volume volume-8b344029-c084-4a63-9ed9-5dacc7aee11d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:12.218193 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Created reservations ['acfbf258-7239-4f04-9197-a0fe9deab046', '60234239-9c86-4df8-bfef-d3d21e06c080', '557a0956-f635-48a6-9645-0162ead25188', 'c7d3fa88-27b0-4f8b-bcfe-2daac6d0bca4'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:12.299394 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Delete snapshot completed successfully.
Oct 08 21:19:12.309069 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-711cf8f3-f5ac-4d6c-a000-6ab2682be7e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Lock "cinder-96714edb-c581-4437-addf-1e995d417b8a-delete_snapshot" released by "delete_snapshot" :: held 1.401s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:12.413399 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Created reservations ['df782249-0bde-41b0-bbad-ddb650288685', '12a999ec-8879-4660-96d4-722a69f59b17', 'bb73fa99-f3e2-43cb-9692-2224088dcc09', 'db596e3d-352d-4fa9-9de1-731d3915843d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:12.548761 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:DELETE=5,cinder:INSERT=7,cinder:UPDATE=29 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:12.604662 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:12.704520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:12.767594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:12.782237 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Deleted volume successfully.
Oct 08 21:19:12.810526 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0259eebe-9d62-4e23-9ecf-6a1ec67e894e tempest-VolumeQuotasAdminTestJSON-1811975681 None] Lock "cinder-8b344029-c084-4a63-9ed9-5dacc7aee11d-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:13.133761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Acquiring lock "cinder-d04b3997-c6cb-453d-9534-af0eca0e3e0e-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:13.163059 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Lock "cinder-d04b3997-c6cb-453d-9534-af0eca0e3e0e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:13.251885 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:13.325334 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:13.430204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:13.430691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Volume volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:13.447005 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] deleting rbd volume volume-d04b3997-c6cb-453d-9534-af0eca0e3e0e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:13.769055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:13.827067 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Flow 'volume_create_manager' (32b8d889-e641-4ee8-bf8b-3e6b7ff837c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:13.843663 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200e30c-498f-44e4-a965-dede91bebcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:13.906060 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200e30c-498f-44e4-a965-dede91bebcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1249876821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=925afbce-ec3b-4209-8627-befecb5320a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5ebbb0ec7c4a92aa6b857dc95dc620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:14Z,use_quota=True,user_id='41787fb5fc0e4c328f5c42d7ccaa4420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:13.915106 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f300aaa6-339a-45f3-a8e8-74b4671a4c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:13.920179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f300aaa6-339a-45f3-a8e8-74b4671a4c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:13.938633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15642dd2-2f25-48ee-8451-8f709cd5bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:13.943247 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15642dd2-2f25-48ee-8451-8f709cd5bedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925afbce-ec3b-4209-8627-befecb5320a4', 'volume_name': 'volume-925afbce-ec3b-4209-8627-befecb5320a4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:13.948150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1398b9c9-a8a6-41dc-880e-880f46fb67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:13.952542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1398b9c9-a8a6-41dc-880e-880f46fb67e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:13.958581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19969511-5828-4368-ae66-548ee9ba3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:13.959670 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume 925afbce-ec3b-4209-8627-befecb5320a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925afbce-ec3b-4209-8627-befecb5320a4', 'volume_size': 1}
Oct 08 21:19:13.961086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] creating volume 'volume-925afbce-ec3b-4209-8627-befecb5320a4' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:13.961895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:14.067588 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Created reservations ['2ea6ce8c-f328-4b18-839a-1d78883f092f', '804fca88-675f-4b2b-aaa0-cbe065a4c61d', '0895d1d0-5be5-4f5c-8980-38ca31b1685e', '41d9dad7-2f9d-407b-a8f2-79ebaaa76ea3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:14.084149 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:14.084581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:14.089314 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19969511-5828-4368-ae66-548ee9ba3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925afbce-ec3b-4209-8627-befecb5320a4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:14.094668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68787f3a-49be-4e7f-93cc-014018beb0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:14.115372 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Volume volume-925afbce-ec3b-4209-8627-befecb5320a4 (925afbce-ec3b-4209-8627-befecb5320a4): created successfully
Oct 08 21:19:14.120088 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68787f3a-49be-4e7f-93cc-014018beb0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:14.126765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Flow 'volume_create_manager' (32b8d889-e641-4ee8-bf8b-3e6b7ff837c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:14.145157 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-66c56499-61e7-401e-977c-da2e76e29b39 tempest-VolumeQuotasAdminTestJSON-1811975681 None] Created volume successfully.
Oct 08 21:19:14.202701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:14.311321 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:14.366832 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:14.372718 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Deleted volume successfully.
Oct 08 21:19:14.392896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5180fe14-cbd9-45df-9878-39493abfeb6b tempest-VolumeSnapshotQuotasNegativeTestJSON-642943452 None] Lock "cinder-d04b3997-c6cb-453d-9534-af0eca0e3e0e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:16.016441 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-31ca4b0c-15cc-490a-81ee-8fb0e51feea9 tempest-VolumeQuotasAdminTestJSON-1662509699 None] Transfer volume completed successfully.
Oct 08 21:19:16.746033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Acquiring lock "cinder-925afbce-ec3b-4209-8627-befecb5320a4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:16.765531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Lock "cinder-925afbce-ec3b-4209-8627-befecb5320a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:16.838649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:16.920938 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:16.921408 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Volume volume-925afbce-ec3b-4209-8627-befecb5320a4 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:16.926980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] deleting rbd volume volume-925afbce-ec3b-4209-8627-befecb5320a4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:17.295414 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Created reservations ['315c9ee5-d659-4bdb-9b50-c57d9e8bcbe6', 'bbcdaeb4-1530-4ee2-8c9b-f34cd6ebfd4a', '3db07956-ea04-426a-93f9-5c6ab6d0bf60', '0169106c-1ca4-4231-890e-a44b4cb88aeb'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:17.394482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:17.470397 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:17.518716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:17.529760 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Deleted volume successfully.
Oct 08 21:19:17.553748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-5cbc0051-e401-4efa-92b9-ff93e779cee8 tempest-VolumeQuotasAdminTestJSON-1819151071 None] Lock "cinder-925afbce-ec3b-4209-8627-befecb5320a4-delete_volume" released by "delete_volume" :: held 0.789s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:24.958705 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:24.978415 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Flow 'volume_create_manager' (6443f42c-2fd0-40d6-b164-1d472aaca121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:24.985414 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b4de6-3536-428b-8b20-313506d27b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.001522 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b4de6-3536-428b-8b20-313506d27b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1671481327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6e7b11a-4994-4672-a8b6-2df36afff470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bcd32262fb4b00b99260e3db3e5246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:25Z,use_quota=True,user_id='2564503039b343d8a2f5a483fd05c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.006885 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d6239-546f-4f03-bee3-a794d9ff7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.011217 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d6239-546f-4f03-bee3-a794d9ff7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.016265 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c4fb59-e3eb-4e83-95dd-ba94d2f195fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.020430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c4fb59-e3eb-4e83-95dd-ba94d2f195fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e7b11a-4994-4672-a8b6-2df36afff470', 'volume_name': 'volume-a6e7b11a-4994-4672-a8b6-2df36afff470', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.025160 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d21cb1-d5ad-4b42-a24a-47914f84d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.030830 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d21cb1-d5ad-4b42-a24a-47914f84d159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.035290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f42bf83-f5e8-4313-b0ad-0e989e5e07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.036349 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Volume a6e7b11a-4994-4672-a8b6-2df36afff470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e7b11a-4994-4672-a8b6-2df36afff470', 'volume_size': 1}
Oct 08 21:19:25.036740 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] creating volume 'volume-a6e7b11a-4994-4672-a8b6-2df36afff470' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:25.037521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:25.108611 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:25.109839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:25.115356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f42bf83-f5e8-4313-b0ad-0e989e5e07e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e7b11a-4994-4672-a8b6-2df36afff470', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.121626 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb94850-06a4-4653-82b8-e10686ea74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.132948 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Volume volume-a6e7b11a-4994-4672-a8b6-2df36afff470 (a6e7b11a-4994-4672-a8b6-2df36afff470): created successfully
Oct 08 21:19:25.137251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb94850-06a4-4653-82b8-e10686ea74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.145401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Flow 'volume_create_manager' (6443f42c-2fd0-40d6-b164-1d472aaca121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:25.157971 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4e6d3c0d-a4d3-4d07-a642-55d4af77b29f tempest-SnapshotMetadataTestJSON-1056040092 None] Created volume successfully.
Oct 08 21:19:25.480154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:25.501364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Flow 'volume_create_manager' (09c5c810-faa3-4252-bdc9-49b39426b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:25.507874 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9a762-05db-406c-a1ba-44d4cf87e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.524238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9a762-05db-406c-a1ba-44d4cf87e722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-378384268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6f40353-1ddf-4885-9f5b-78d223f1eb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c155f60b9604c2ba97908597a0dfd93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:25Z,use_quota=True,user_id='1d5a4119d245437ba730c5168145382d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(feeca5ba-593d-4c29-90ea-9eeff46a731d),volume_type_id=feeca5ba-593d-4c29-90ea-9eeff46a731d)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.529656 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fd8947-59b0-458b-ae9d-7092de3fc210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.533553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fd8947-59b0-458b-ae9d-7092de3fc210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.538562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed0efc-aa60-4077-8112-b59a19567429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.542796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed0efc-aa60-4077-8112-b59a19567429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f40353-1ddf-4885-9f5b-78d223f1eb1e', 'volume_name': 'volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.548171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4cb320-02a5-447f-bf52-7b1fe33a4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.552079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4cb320-02a5-447f-bf52-7b1fe33a4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.556576 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f4b72d-bbc9-4244-8c93-f330b1b43a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.557659 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Volume b6f40353-1ddf-4885-9f5b-78d223f1eb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e', 'volume_size': 1}
Oct 08 21:19:25.558094 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] creating volume 'volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:25.558774 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:25.613336 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:25.613712 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:25.618193 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f4b72d-bbc9-4244-8c93-f330b1b43a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.623298 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2859f7b5-527d-44af-aa5f-29e37468c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:25.632246 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Volume volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e (b6f40353-1ddf-4885-9f5b-78d223f1eb1e): created successfully
Oct 08 21:19:25.636086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2859f7b5-527d-44af-aa5f-29e37468c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:25.641433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Flow 'volume_create_manager' (09c5c810-faa3-4252-bdc9-49b39426b65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:25.650009 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f172128a-3217-402a-9b34-f7051e42d1b8 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Created volume successfully.
Oct 08 21:19:26.192362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5566043f-2272-4bb5-a6d0-0cce5e9e78e0 tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:26.936427 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5566043f-2272-4bb5-a6d0-0cce5e9e78e0 tempest-SnapshotMetadataTestJSON-1056040092 None] Create snapshot completed successfully
Oct 08 21:19:26.941922 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a385683-3675-4e21-8bb9-1660698fb5ad tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:27.017360 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a385683-3675-4e21-8bb9-1660698fb5ad tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:27.087092 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-3a385683-3675-4e21-8bb9-1660698fb5ad tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:27.093778 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3a385683-3675-4e21-8bb9-1660698fb5ad tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Retype volume completed successfully.
Oct 08 21:19:27.120754 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 req-8385e2ae-8364-48d3-8bef-f96bbb64e60d tempest-VolumesSnapshotTestJSON-547814895 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:19:27.925221 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 req-8385e2ae-8364-48d3-8bef-f96bbb64e60d tempest-VolumesSnapshotTestJSON-547814895 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.804s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:19:27.925748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 req-8385e2ae-8364-48d3-8bef-f96bbb64e60d tempest-VolumesSnapshotTestJSON-547814895 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:19:27.961864 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 req-8385e2ae-8364-48d3-8bef-f96bbb64e60d tempest-VolumesSnapshotTestJSON-547814895 None] Connection info returned from driver {'name': 'volumes/volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6e294ba-6781-4b55-bc1c-d34d92ef1ea3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6791bc35-382d-43b7-8be0-3cc8c7981cc0'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:19:28.001419 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] Acquiring lock "cinder-820cf7e9-7092-4ff8-8843-09e11277ac5b-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:28.031275 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] Lock "cinder-820cf7e9-7092-4ff8-8843-09e11277ac5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:28.033072 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:28.140939 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-b25eac38-e0d8-49c7-85a0-a35af98d9ae9 req-8385e2ae-8364-48d3-8bef-f96bbb64e60d tempest-VolumesSnapshotTestJSON-547814895 None] attachment_update completed successfully.
Oct 08 21:19:28.378814 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Acquiring lock "cinder-b6f40353-1ddf-4885-9f5b-78d223f1eb1e-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:28.392895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Lock "cinder-b6f40353-1ddf-4885-9f5b-78d223f1eb1e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:28.399542 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=66,cinder:DELETE=3,cinder:UPDATE=27,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:28.408579 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:28.448490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:28.509933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:28.510455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Volume volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:28.517659 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] deleting rbd volume volume-b6f40353-1ddf-4885-9f5b-78d223f1eb1e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:28.763437 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:19:28.764227 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:19:28.784486 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Created reservations ['ba5b7a4e-79c0-4a39-8892-fc6cd63d76e6', '77e67a27-4181-4e9f-a63b-d021bb133254', 'b36265a3-2b6a-4de0-9ac0-a93901291fa9', 'aebe3285-3941-4b94-9298-d3e83672dc3f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:28.849695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:28.890914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:28.926432 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:28.945864 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Deleted volume successfully.
Oct 08 21:19:28.967727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6cafb13e-ee56-4773-91e5-737ed3f04a50 tempest-VolumeRetypeWithoutMigrationTest-733838960 None] Lock "cinder-b6f40353-1ddf-4885-9f5b-78d223f1eb1e-delete_volume" released by "delete_volume" :: held 0.575s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:28.990577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] Created reservations ['facdf203-fabb-427e-81a2-31da5a67e66c', 'f8a0e698-9c49-406d-a063-320a5f589b76', '4543be38-827a-434e-b672-1020eeea4f70', '4ed170e8-d5dc-443f-ac65-ebd3ed8a704a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:29.043244 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] Delete snapshot completed successfully.
Oct 08 21:19:29.050773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-21f26eb8-b619-4655-aadf-a15bdac91887 tempest-SnapshotMetadataTestJSON-1056040092 None] Lock "cinder-820cf7e9-7092-4ff8-8843-09e11277ac5b-delete_snapshot" released by "delete_snapshot" :: held 1.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:29.241415 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Acquiring lock "cinder-a6e7b11a-4994-4672-a8b6-2df36afff470-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:29.252963 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Lock "cinder-a6e7b11a-4994-4672-a8b6-2df36afff470-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:29.299827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:29.360794 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:29.361253 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Volume volume-a6e7b11a-4994-4672-a8b6-2df36afff470 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:29.366270 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] deleting rbd volume volume-a6e7b11a-4994-4672-a8b6-2df36afff470 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:29.758681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Created reservations ['f3805062-d17b-4815-bcd4-7b05749483a7', '560b5156-8901-4fc2-a630-493ee2b8a0a8', '14a829d5-d4fc-4bde-96a2-df60a18363d2', '303bbf85-cc7f-410b-be70-e2c4c95ed9c9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:29.858666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:29.938804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:30.025462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:30.031909 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Deleted volume successfully.
Oct 08 21:19:30.052885 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3f51254b-c076-4e6a-a817-afd783345313 tempest-SnapshotMetadataTestJSON-1056040092 None] Lock "cinder-a6e7b11a-4994-4672-a8b6-2df36afff470-delete_volume" released by "delete_volume" :: held 0.800s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:30.766423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c48348ab-a196-4d69-82fe-af2f8e590187 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:31.999210 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c48348ab-a196-4d69-82fe-af2f8e590187 tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:19:32.380577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:32.453299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (dccdeb6e-9539-4bfd-b1df-84e01153f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:32.471885 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10b413e-220d-4b96-8768-7c3256a44382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.518698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10b413e-220d-4b96-8768-7c3256a44382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-999129092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d458bc31-f884-43a4-91ca-db2ca3bc5e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d29b90ab34abbadd21edbca637d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:32Z,use_quota=True,user_id='8957041987c8487099f0d89f4c64af66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.527056 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ede686-607d-4e0e-90af-57e51bb8fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.533174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ede686-607d-4e0e-90af-57e51bb8fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.538761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4e29c1-0cf8-44f1-8511-5d854d5fb672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.546806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4e29c1-0cf8-44f1-8511-5d854d5fb672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd458bc31-f884-43a4-91ca-db2ca3bc5e66', 'volume_name': 'volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.554545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9a275-9b5a-4d51-938e-8062f51781d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.561631 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9a275-9b5a-4d51-938e-8062f51781d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.572997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a07413-3ee4-45e1-9a7d-4eb91ec52f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.574565 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Volume d458bc31-f884-43a4-91ca-db2ca3bc5e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66', 'volume_size': 1}
Oct 08 21:19:32.575186 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] creating volume 'volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:32.576226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:32.695850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:32.696617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:32.702729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a07413-3ee4-45e1-9a7d-4eb91ec52f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.709338 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bab84fb-0f39-41a7-aad1-c018b5e91b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:32.745235 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66 (d458bc31-f884-43a4-91ca-db2ca3bc5e66): created successfully
Oct 08 21:19:32.755070 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bab84fb-0f39-41a7-aad1-c018b5e91b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:32.789158 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Flow 'volume_create_manager' (dccdeb6e-9539-4bfd-b1df-84e01153f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:32.818880 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5dd4bb0b-5cc0-4f59-9c60-1c3e56ced505 tempest-AttachVolumeNegativeTest-1956575659 None] Created volume successfully.
Oct 08 21:19:33.178709 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-645ebfc3-0aea-4d20-b42e-e30261c34c7e tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:34.081551 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-645ebfc3-0aea-4d20-b42e-e30261c34c7e tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:19:34.399308 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-9b49b917-f567-4590-ab2b-97cfc48d9ffa-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:34.420550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-9b49b917-f567-4590-ab2b-97cfc48d9ffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:34.422357 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:34.655567 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-50367f4d-57ad-43f7-88d9-c510b973704b req-9b0b9533-27f6-41c9-a46d-f0191c7e95a5 tempest-AttachVolumeNegativeTest-1956575659 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:19:35.884656 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:35.931135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Flow 'volume_create_manager' (8a1aadbf-5750-43c2-a2d0-689bd2e05caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:35.946587 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902ad03b-8936-41b4-bb7c-1e4275c24c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:35.974189 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902ad03b-8936-41b4-bb7c-1e4275c24c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1567237885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=37ae666d-02b1-4ffe-9bb0-dc712c3852d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18743cc3f9464d598ab746f2f6fee56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:36Z,use_quota=True,user_id='3d82af78ce1b4924bcb5fc7fc86579ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:35.982855 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8d6ff-4770-4b09-98f0-11d71a86e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:35.990590 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8d6ff-4770-4b09-98f0-11d71a86e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:35.996956 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e480e04-9ed1-48e6-ae49-b1d313655f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.002292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e480e04-9ed1-48e6-ae49-b1d313655f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ae666d-02b1-4ffe-9bb0-dc712c3852d1', 'volume_name': 'volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.007889 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaf45d8-1267-49cc-acfa-be64128316d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.012527 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaf45d8-1267-49cc-acfa-be64128316d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.017529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0999c1-4d28-41b7-90ad-e46f6d938693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.018899 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Volume 37ae666d-02b1-4ffe-9bb0-dc712c3852d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1', 'volume_size': 1}
Oct 08 21:19:36.019641 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] creating volume 'volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:36.020657 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:36.070588 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-50367f4d-57ad-43f7-88d9-c510b973704b req-9b0b9533-27f6-41c9-a46d-f0191c7e95a5 tempest-AttachVolumeNegativeTest-1956575659 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.415s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:19:36.071214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-50367f4d-57ad-43f7-88d9-c510b973704b req-9b0b9533-27f6-41c9-a46d-f0191c7e95a5 tempest-AttachVolumeNegativeTest-1956575659 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd458bc31-f884-43a4-91ca-db2ca3bc5e66', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:19:36.116444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-50367f4d-57ad-43f7-88d9-c510b973704b req-9b0b9533-27f6-41c9-a46d-f0191c7e95a5 tempest-AttachVolumeNegativeTest-1956575659 None] Connection info returned from driver {'name': 'volumes/volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd458bc31-f884-43a4-91ca-db2ca3bc5e66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '05d9a6b7-d351-4225-9689-21be8f66023c'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:19:36.179178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:36.179839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:36.189394 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0999c1-4d28-41b7-90ad-e46f6d938693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.195252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5229e868-231d-4d3e-8a3a-1e7d61ab79c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.223456 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Volume volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1 (37ae666d-02b1-4ffe-9bb0-dc712c3852d1): created successfully
Oct 08 21:19:36.236398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5229e868-231d-4d3e-8a3a-1e7d61ab79c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.251158 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Flow 'volume_create_manager' (8a1aadbf-5750-43c2-a2d0-689bd2e05caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:36.284794 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:36.305098 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2242472b-621e-49a3-b0a3-55c9e3602e00 tempest-VolumesMetadataTest-1783369854 None] Created volume successfully.
Oct 08 21:19:36.320259 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=64,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:36.331418 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-50367f4d-57ad-43f7-88d9-c510b973704b req-9b0b9533-27f6-41c9-a46d-f0191c7e95a5 tempest-AttachVolumeNegativeTest-1956575659 None] attachment_update completed successfully.
Oct 08 21:19:36.347780 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:36.376390 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Flow 'volume_create_manager' (a4c6e8f9-fe72-48da-a4f4-c68e7e638037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:36.384647 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d5f3a8-6dca-444b-b550-3f842c0ee19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.408419 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d5f3a8-6dca-444b-b550-3f842c0ee19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-989142205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d17c058b-5b90-4923-8332-82416b8ecefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f564837d8eb4b3192109d0dfc9a6fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:36Z,use_quota=True,user_id='537b77eca97d4c1395eeb164bc5e7205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.414682 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660dc70b-67a6-4ad8-85aa-aa43c8af4d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.421290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660dc70b-67a6-4ad8-85aa-aa43c8af4d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.426659 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dd9977-7adc-40c3-8adb-a854eb4d1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.430963 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dd9977-7adc-40c3-8adb-a854eb4d1c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17c058b-5b90-4923-8332-82416b8ecefb', 'volume_name': 'volume-d17c058b-5b90-4923-8332-82416b8ecefb', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.438055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d25ac1-c8b3-4740-a74d-46a0bee5fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.442309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d25ac1-c8b3-4740-a74d-46a0bee5fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.447273 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3b284b-2713-4dda-8155-a1e0a88e64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.448560 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Volume d17c058b-5b90-4923-8332-82416b8ecefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17c058b-5b90-4923-8332-82416b8ecefb', 'volume_size': 1}
Oct 08 21:19:36.449818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] creating volume 'volume-d17c058b-5b90-4923-8332-82416b8ecefb' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:36.450689 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:36.566986 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:36.567361 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:36.571501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3b284b-2713-4dda-8155-a1e0a88e64f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17c058b-5b90-4923-8332-82416b8ecefb', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.580506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b42d11-fd14-4e0b-9458-661112ad35f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:36.608705 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Volume volume-d17c058b-5b90-4923-8332-82416b8ecefb (d17c058b-5b90-4923-8332-82416b8ecefb): created successfully
Oct 08 21:19:36.615156 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b42d11-fd14-4e0b-9458-661112ad35f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:36.635811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Flow 'volume_create_manager' (a4c6e8f9-fe72-48da-a4f4-c68e7e638037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:36.656770 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-df9c77f6-7189-41f2-9957-523789b5bcb8 tempest-VolumesActionsTest-42924472 None] Created volume successfully.
Oct 08 21:19:37.510346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Acquiring lock "cinder-37ae666d-02b1-4ffe-9bb0-dc712c3852d1-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:37.535598 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Lock "cinder-37ae666d-02b1-4ffe-9bb0-dc712c3852d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:37.651928 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:37.722701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:37.723154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Volume volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:37.731659 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] deleting rbd volume volume-37ae666d-02b1-4ffe-9bb0-dc712c3852d1 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:38.045207 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Created reservations ['dc949379-cc2c-4576-99da-a233ff738782', 'c9e4c688-0b20-43c2-88ca-2d86c5a60f0a', 'd91c310f-5d60-4d16-a272-d0198928d715', '1fc15b9d-dc0a-4cdf-b175-58911ff557fc'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:38.140026 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:38.207025 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:38.287599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:38.293455 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Deleted volume successfully.
Oct 08 21:19:38.315685 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f2d0a3ed-797d-4057-918e-ade95f478e98 tempest-VolumesMetadataTest-1783369854 None] Lock "cinder-37ae666d-02b1-4ffe-9bb0-dc712c3852d1-delete_volume" released by "delete_volume" :: held 0.788s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:40.071562 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-f0410730-db9a-4a76-b723-9641ba3998da req-18b27eed-e5d8-4a7a-9616-3b21d3989658 tempest-AttachVolumeNegativeTest-1956575659 None] Terminate volume connection completed successfully.
Oct 08 21:19:40.074501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f0410730-db9a-4a76-b723-9641ba3998da req-18b27eed-e5d8-4a7a-9616-3b21d3989658 tempest-AttachVolumeNegativeTest-1956575659 None] Deleting attachment 05d9a6b7-d351-4225-9689-21be8f66023c. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:19:43.991020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:44.016381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Flow 'volume_create_manager' (4e9477f5-9b3b-44e9-b2bb-c1a1c8ea7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:44.027704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142932d9-17c5-4296-a25c-8e39c4abdedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.080815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142932d9-17c5-4296-a25c-8e39c4abdedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1611033868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=006ea29a-d88d-425f-80af-cddf3596c901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe1a9c7dceb4c20b33ec10277b70c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:44Z,use_quota=True,user_id='4b747613f34b45d08905aa98dec04f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.097096 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d09f05-ecb2-4e93-8506-f2d85667edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.104226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d09f05-ecb2-4e93-8506-f2d85667edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.114590 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2934bfbc-1770-4dae-872f-0f516c49a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.119629 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2934bfbc-1770-4dae-872f-0f516c49a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006ea29a-d88d-425f-80af-cddf3596c901', 'volume_name': 'volume-006ea29a-d88d-425f-80af-cddf3596c901', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.142042 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9159a91-accf-4633-af4b-0db7dc9aecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.146655 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9159a91-accf-4633-af4b-0db7dc9aecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.151893 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd3800a-dc7f-4f40-b283-7e143334b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.153904 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Volume 006ea29a-d88d-425f-80af-cddf3596c901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006ea29a-d88d-425f-80af-cddf3596c901', 'volume_size': 1}
Oct 08 21:19:44.154547 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] creating volume 'volume-006ea29a-d88d-425f-80af-cddf3596c901' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:44.155555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:44.311651 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:44.312199 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:44.316462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd3800a-dc7f-4f40-b283-7e143334b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006ea29a-d88d-425f-80af-cddf3596c901', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.324577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a737def-16d2-461a-9da6-0e83b53aa386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:44.338717 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Volume volume-006ea29a-d88d-425f-80af-cddf3596c901 (006ea29a-d88d-425f-80af-cddf3596c901): created successfully
Oct 08 21:19:44.342984 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a737def-16d2-461a-9da6-0e83b53aa386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:44.351239 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Flow 'volume_create_manager' (4e9477f5-9b3b-44e9-b2bb-c1a1c8ea7976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:44.384938 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7328c2bf-c727-46e6-9cd3-fdff1d1a971a tempest-VolumesTransfersV357Test-617464389 None] Created volume successfully.
Oct 08 21:19:46.526549 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dfff082b-19dd-4aa7-8cfd-806fc4b22861 tempest-VolumesTransfersV357Test-997247124 None] Transfer volume completed successfully.
Oct 08 21:19:47.483607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Acquiring lock "cinder-006ea29a-d88d-425f-80af-cddf3596c901-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:47.497678 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Lock "cinder-006ea29a-d88d-425f-80af-cddf3596c901-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:47.587477 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:47.660860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:47.661550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Volume volume-006ea29a-d88d-425f-80af-cddf3596c901 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:47.674418 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] deleting rbd volume volume-006ea29a-d88d-425f-80af-cddf3596c901 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:48.072180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Created reservations ['3fd26ff0-739a-4992-9966-7cf1680c7658', '15170382-2517-472c-8775-bcceec29050f', 'efde5d26-0d3e-4e36-848e-2cfb9ef2aed1', '79c3526a-19ae-4851-95b6-43ab02ded9ae'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:48.188717 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:48.237430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:48.292805 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:48.298658 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Deleted volume successfully.
Oct 08 21:19:48.331940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-538afb7b-60c7-4d6f-b682-e554863c07a8 tempest-VolumesTransfersV357Test-398215975 None] Lock "cinder-006ea29a-d88d-425f-80af-cddf3596c901-delete_volume" released by "delete_volume" :: held 0.833s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:49.236995 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:19:49.263865 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Flow 'volume_create_manager' (8e8a1c41-bb7d-4766-af80-77e0420ba3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:49.276279 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979c017-a568-4564-9f9d-f3f8cbf14b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.312932 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979c017-a568-4564-9f9d-f3f8cbf14b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1694297907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=279f04ed-a0a3-407d-ad08-9c6084665c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe1a9c7dceb4c20b33ec10277b70c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:19:49Z,use_quota=True,user_id='4b747613f34b45d08905aa98dec04f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.321607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d85ef7-43f2-449a-814a-63a133eaf5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.328086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d85ef7-43f2-449a-814a-63a133eaf5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.335581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016058e7-c844-4778-932f-086072b8ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.342145 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016058e7-c844-4778-932f-086072b8ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279f04ed-a0a3-407d-ad08-9c6084665c6e', 'volume_name': 'volume-279f04ed-a0a3-407d-ad08-9c6084665c6e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.348406 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f99c09b-d7b1-49ef-9a09-ffb549054e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.353695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f99c09b-d7b1-49ef-9a09-ffb549054e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.373307 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fb4a0d-8215-4785-9761-df3720c845df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.374693 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Volume 279f04ed-a0a3-407d-ad08-9c6084665c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279f04ed-a0a3-407d-ad08-9c6084665c6e', 'volume_size': 1}
Oct 08 21:19:49.375103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] creating volume 'volume-279f04ed-a0a3-407d-ad08-9c6084665c6e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:19:49.375891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:49.444288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Acquiring lock "cinder-d458bc31-f884-43a4-91ca-db2ca3bc5e66-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:49.458477 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-d458bc31-f884-43a4-91ca-db2ca3bc5e66-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:49.496823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:49.561571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:49.562131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:49.567180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] deleting rbd volume volume-d458bc31-f884-43a4-91ca-db2ca3bc5e66 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:49.575725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:19:49.576136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:19:49.581117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fb4a0d-8215-4785-9761-df3720c845df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279f04ed-a0a3-407d-ad08-9c6084665c6e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.588356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203044bd-3b1b-45d3-a1b9-04b7b6f934e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:19:49.602005 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Volume volume-279f04ed-a0a3-407d-ad08-9c6084665c6e (279f04ed-a0a3-407d-ad08-9c6084665c6e): created successfully
Oct 08 21:19:49.607307 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203044bd-3b1b-45d3-a1b9-04b7b6f934e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:19:49.615650 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Flow 'volume_create_manager' (8e8a1c41-bb7d-4766-af80-77e0420ba3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:19:49.633350 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c87080b3-b8cf-49cc-b068-0099efb70f5a tempest-VolumesTransfersV357Test-617464389 None] Created volume successfully.
Oct 08 21:19:49.822001 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Created reservations ['018afd8e-e836-42fa-8e8f-7368ea60dd74', 'eb49d9fe-8074-459a-8aa3-66a501ecb5ce', '7126930b-fb7e-4e06-a994-7553e0590891', '65f545e1-cdf7-43d4-8fcf-015672404821'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:49.878403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:49.921485 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:49.957257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:49.962471 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Deleted volume successfully.
Oct 08 21:19:49.985252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c1be0f7-c8a3-4ae8-8553-7f66bb8adcf7 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-d458bc31-f884-43a4-91ca-db2ca3bc5e66-delete_volume" released by "delete_volume" :: held 0.530s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:50.605962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Acquiring lock "cinder-279f04ed-a0a3-407d-ad08-9c6084665c6e-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:50.621444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Lock "cinder-279f04ed-a0a3-407d-ad08-9c6084665c6e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:50.672021 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Acquiring lock "cinder-846bd1eb-e484-4b7e-aa01-8cf22106cec3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:50.680713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:50.755868 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:50.756833 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Volume volume-279f04ed-a0a3-407d-ad08-9c6084665c6e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:50.766446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] deleting rbd volume volume-279f04ed-a0a3-407d-ad08-9c6084665c6e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:50.785604 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-846bd1eb-e484-4b7e-aa01-8cf22106cec3-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:50.851111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:50.952854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:50.953381 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:50.958858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] deleting rbd volume volume-846bd1eb-e484-4b7e-aa01-8cf22106cec3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:51.065806 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:51.084949 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:19:51.120256 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Created reservations ['2d05b769-276e-4e23-b317-05a71f6653ad', 'f1473257-9a13-4fb9-a485-1ed9e4876c79', 'ed3c3ada-c23c-4574-9ae5-6f7db0351427', 'b35ded89-425c-48ca-8b07-607ddac38698'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:51.207721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:51.266797 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:51.305548 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:51.313482 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Deleted volume successfully.
Oct 08 21:19:51.335196 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-7482d837-6c52-447b-b3d4-299397ee0bfd tempest-VolumesTransfersV357Test-398215975 None] Lock "cinder-279f04ed-a0a3-407d-ad08-9c6084665c6e-delete_volume" released by "delete_volume" :: held 0.714s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:51.358848 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Created reservations ['05785fd0-91e0-4162-998d-556d0a7281cb', '89d1c05f-f7a9-47ce-b58f-91e888694c5a', '81f42a93-58ae-4191-af5f-54375cc34789', '4d2c5785-c4d0-4963-8119-bd03a3f28841'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:51.415412 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:51.453099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:51.492105 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:51.497103 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Deleted volume successfully.
Oct 08 21:19:51.514490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2c5170d-1f28-4710-bbf0-8d5283fe9939 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-846bd1eb-e484-4b7e-aa01-8cf22106cec3-delete_volume" released by "delete_volume" :: held 0.729s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:52.148063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Acquiring lock "cinder-71c4c902-18fd-4291-83f7-50d37cc1baef-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:52.196624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-71c4c902-18fd-4291-83f7-50d37cc1baef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:52.256673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:52.326705 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:19:52.327260 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Volume volume-71c4c902-18fd-4291-83f7-50d37cc1baef is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:19:52.333742 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] deleting rbd volume volume-71c4c902-18fd-4291-83f7-50d37cc1baef {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:19:52.630989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Created reservations ['ea3aa257-067f-4faf-9023-2f48ae1757f1', 'b13460d3-639b-413c-a38a-f813af251bd3', '1ece6255-7232-4f81-bd7d-ea7a783e6642', '63606498-9d0a-4c97-9f46-d1a94fa6012c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:19:52.684221 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:52.741387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:19:52.790844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:19:52.795510 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Deleted volume successfully.
Oct 08 21:19:52.815175 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6ed45da3-a5b2-4769-8371-05e2614e1668 tempest-AttachVolumeNegativeTest-1956575659 None] Lock "cinder-71c4c902-18fd-4291-83f7-50d37cc1baef-delete_volume" released by "delete_volume" :: held 0.630s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:56.196255 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3af3e44-a14f-4b41-926e-728b8be888eb tempest-VolumesActionsTest-42924472 None] Acquiring lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" by "attach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:56.211725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3af3e44-a14f-4b41-926e-728b8be888eb tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" acquired by "attach_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:56.278378 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d3af3e44-a14f-4b41-926e-728b8be888eb tempest-VolumesActionsTest-42924472 None] Attaching volume d17c058b-5b90-4923-8332-82416b8ecefb to instance b7ffbec5-a184-4436-a26c-2188339770cd at mountpoint /dev/sdb on host None.
Oct 08 21:19:56.329940 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d3af3e44-a14f-4b41-926e-728b8be888eb tempest-VolumesActionsTest-42924472 None] Attach volume completed successfully.
Oct 08 21:19:56.338169 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3af3e44-a14f-4b41-926e-728b8be888eb tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" released by "attach_volume" :: held 0.126s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:19:56.621638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-55a29d19-ae29-4d57-8701-f15968d33429 tempest-VolumesActionsTest-42924472 None] Acquiring lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" by "detach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:19:56.633710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-55a29d19-ae29-4d57-8701-f15968d33429 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:19:56.634530 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-55a29d19-ae29-4d57-8701-f15968d33429 tempest-VolumesActionsTest-42924472 None] Detaching volume d17c058b-5b90-4923-8332-82416b8ecefb from instance b7ffbec5-a184-4436-a26c-2188339770cd.
Oct 08 21:19:56.718815 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-55a29d19-ae29-4d57-8701-f15968d33429 tempest-VolumesActionsTest-42924472 None] Detach volume completed successfully.
Oct 08 21:19:56.725127 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-55a29d19-ae29-4d57-8701-f15968d33429 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:00.764269 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c4f2b5bb-df37-4b5e-af30-60cc371147ca tempest-GroupsV314Test-1961758143 None] Group tempest-GroupsV314Test-Group-1334778420: creating
Oct 08 21:20:00.790515 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c4f2b5bb-df37-4b5e-af30-60cc371147ca tempest-GroupsV314Test-1961758143 None] Group tempest-GroupsV314Test-Group-1334778420: created successfully
Oct 08 21:20:00.802160 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c4f2b5bb-df37-4b5e-af30-60cc371147ca tempest-GroupsV314Test-1961758143 None] Create group completed successfully.
Oct 08 21:20:01.799618 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:01.826483 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Flow 'volume_create_manager' (6facdffe-44a1-4a3d-8b55-a0af8b51f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:01.834400 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0660f2-f45e-4222-92a7-f263052eda63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:01.852080 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0660f2-f45e-4222-92a7-f263052eda63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-498815044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=07729230-57f6-425c-b3ef-80f8fd199654,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ba0c1d321704635930a5017713e75b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:02Z,use_quota=True,user_id='41b81a1fe7a245a5bd454b97e7365dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:01.859897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132e529b-dcd9-4387-8773-75af0eb6e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:01.865084 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132e529b-dcd9-4387-8773-75af0eb6e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:01.872341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b216b391-3049-42c3-90b3-b32416694362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:01.877719 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b216b391-3049-42c3-90b3-b32416694362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07729230-57f6-425c-b3ef-80f8fd199654', 'volume_name': 'volume-07729230-57f6-425c-b3ef-80f8fd199654', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:01.883744 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84128e2b-56a6-4136-8e44-184eb2aa28c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:01.889154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84128e2b-56a6-4136-8e44-184eb2aa28c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:01.894634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba97c90-3640-4162-92c5-a2f13c458cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:01.895763 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Volume 07729230-57f6-425c-b3ef-80f8fd199654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07729230-57f6-425c-b3ef-80f8fd199654', 'volume_size': 1}
Oct 08 21:20:01.896158 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] creating volume 'volume-07729230-57f6-425c-b3ef-80f8fd199654' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:01.897072 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:01.990538 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:01.990917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:01.994618 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba97c90-3640-4162-92c5-a2f13c458cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07729230-57f6-425c-b3ef-80f8fd199654', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.001717 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ff644e-a8af-474a-b8ca-8aeee8fb6279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.018612 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Volume volume-07729230-57f6-425c-b3ef-80f8fd199654 (07729230-57f6-425c-b3ef-80f8fd199654): created successfully
Oct 08 21:20:02.033325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ff644e-a8af-474a-b8ca-8aeee8fb6279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.047487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Flow 'volume_create_manager' (6facdffe-44a1-4a3d-8b55-a0af8b51f12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:02.080418 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-f1e3eb33-99af-492f-8978-b644b94aba4d req-5718ecc1-b65c-42c0-878a-770d2eacf631 tempest-VolumesGetTestJSON-606081357 None] Created volume successfully.
Oct 08 21:20:02.307701 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:02.328827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Flow 'volume_create_manager' (1bef14a1-28eb-4e66-83a3-468096488e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:02.334997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b0872a-4f0b-430e-9970-ca9f13a7d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.350873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b0872a-4f0b-430e-9970-ca9f13a7d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-800759336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbc377c3-253f-4c42-8a0e-631a0fedf44f,host='ncdv-master-1@ceph#ceph',id=506f3552-c14e-4f20-b97d-a5a5769e152e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1038cf24a4d14f5aaf42fc18b1d15569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:02Z,use_quota=True,user_id='178eda00ec4d4658be24753e493891c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e06fc834-32ee-44f5-8b34-a7cf663b8f56),volume_type_id=e06fc834-32ee-44f5-8b34-a7cf663b8f56)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.356797 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2b870-a09d-420b-bd76-8135190a7794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.360802 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2b870-a09d-420b-bd76-8135190a7794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.365822 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d37d2-504d-409d-ab6e-25eb0435b008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.369904 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d37d2-504d-409d-ab6e-25eb0435b008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506f3552-c14e-4f20-b97d-a5a5769e152e', 'volume_name': 'volume-506f3552-c14e-4f20-b97d-a5a5769e152e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.375298 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16df6eaa-5764-4864-b1aa-987ad34e882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.379208 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16df6eaa-5764-4864-b1aa-987ad34e882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.383791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0730d872-ccdc-496e-a620-999b62f184b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.384952 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Volume 506f3552-c14e-4f20-b97d-a5a5769e152e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506f3552-c14e-4f20-b97d-a5a5769e152e', 'volume_size': 1}
Oct 08 21:20:02.385411 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] creating volume 'volume-506f3552-c14e-4f20-b97d-a5a5769e152e' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:02.386082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:02.437930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:02.438305 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:02.441911 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0730d872-ccdc-496e-a620-999b62f184b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506f3552-c14e-4f20-b97d-a5a5769e152e', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.446496 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2432a8b4-4c91-4bd9-88c9-8f016bef3096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:02.456048 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Volume volume-506f3552-c14e-4f20-b97d-a5a5769e152e (506f3552-c14e-4f20-b97d-a5a5769e152e): created successfully
Oct 08 21:20:02.459573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2432a8b4-4c91-4bd9-88c9-8f016bef3096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:02.465613 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Flow 'volume_create_manager' (1bef14a1-28eb-4e66-83a3-468096488e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:02.473586 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d62d1c8b-6c6d-4aa9-b640-1a9b7fc0a36a tempest-GroupsV314Test-1961758143 None] Created volume successfully.
Oct 08 21:20:03.314393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Acquiring lock "cinder-07729230-57f6-425c-b3ef-80f8fd199654-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:03.329705 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Lock "cinder-07729230-57f6-425c-b3ef-80f8fd199654-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:03.368687 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:03.375085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:03.425671 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:20:03.426119 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Volume volume-07729230-57f6-425c-b3ef-80f8fd199654 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:03.430359 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] deleting rbd volume volume-07729230-57f6-425c-b3ef-80f8fd199654 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:03.670889 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Created reservations ['feb9a9ef-8c20-4566-a339-6068e3e5796c', '5011fb34-c6fd-4301-ac93-5a6c004e7d5d', 'b9000d13-e0b1-4c11-836a-729aec20c71c', '7d91b4f2-a579-4cce-afcc-5b938495093a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:03.678555 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=32,cinder:SELECT=57,cinder:INSERT=9,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:03.762442 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:03.826490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:03.889938 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:03.900885 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Deleted volume successfully.
Oct 08 21:20:03.915752 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d17404e7-02d8-4bd4-9f67-879d3a28fe9b req-a09eaa4d-061d-45b2-bd0d-27bbda4f3801 tempest-VolumesGetTestJSON-606081357 None] Lock "cinder-07729230-57f6-425c-b3ef-80f8fd199654-delete_volume" released by "delete_volume" :: held 0.586s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:03.986398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:04.041283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] creating snapshot='volume-215028df-efef-4637-963a-66c676437ed4.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:20:05.081337 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] cloning 'volume-506f3552-c14e-4f20-b97d-a5a5769e152e@volume-215028df-efef-4637-963a-66c676437ed4.clone_snap' to 'volume-215028df-efef-4637-963a-66c676437ed4' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:20:05.190971 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['1cade3bf-02a9-41b4-9a11-267d382cbfea', '59dcf375-a4e5-45ad-887e-724c396e3a81', '58c6b829-48e5-47a4-b89f-eefcbbfed63a', '4f84d10c-803c-4dcf-a16e-0343bf9134eb'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:05.229559 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] Volume volume-506f3552-c14e-4f20-b97d-a5a5769e152e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:05.242649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] extra_specs: {} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:05.243281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] extra_specs: {} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:05.275013 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:20:05.333560 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:20:05.341132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9db2b4ab-afce-4b03-8284-5a0443e50fcb tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-9b49b917-f567-4590-ab2b-97cfc48d9ffa-delete_snapshot" released by "delete_snapshot" :: held 30.922s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:05.355731 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d865eacd-4429-4900-8c8a-691e16edf7d4 tempest-GroupsV314Test-1961758143 None] Create group from source-group-fbc377c3-253f-4c42-8a0e-631a0fedf44f completed successfully.
Oct 08 21:20:05.736437 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-c599053f-757b-464e-8cc2-14e56f639d84-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:05.754151 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-c599053f-757b-464e-8cc2-14e56f639d84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:05.756520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:05.956699 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:20:05.957494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:05.982763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:06.009506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:06.745687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:06.830895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:20:06.841103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] deleting rbd volume volume-215028df-efef-4637-963a-66c676437ed4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:07.046900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:20:07.067216 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Volume volume-506f3552-c14e-4f20-b97d-a5a5769e152e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:07.070895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] deleting parent snapshot volume-215028df-efef-4637-963a-66c676437ed4.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:20:08.162089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Created reservations ['4adc9b17-cd3b-45b2-8f93-40bc7a999347'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:08.180972 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-404527153 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-404527153, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:20:08.181815 ncdv-master-1 cinder-volume[133344]: WARNING cinder.quota [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-404527153 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-404527153, it is now deprecated. Please use the default quota class for default quota.
Oct 08 21:20:08.195700 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Created reservations ['d1d34538-6f54-47a9-a03a-c37b15798dc0', '51c4393d-9d04-4cbc-ac87-8d1177cf3c17', 'e2ff79ad-270c-4fe5-aa8b-898fefb18b65', '2bacbdc0-4d70-47d1-b489-9f8a5b258083'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:08.276630 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:08.304204 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:08.338029 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:08.342874 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-88589c89-4cc5-45fb-b1d5-ca1febd40ce5 tempest-GroupsV314Test-1961758143 None] Delete group completed successfully.
Oct 08 21:20:09.276285 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:09.326875 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:20:09.327306 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] Volume volume-506f3552-c14e-4f20-b97d-a5a5769e152e is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:09.337985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] deleting rbd volume volume-506f3552-c14e-4f20-b97d-a5a5769e152e {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:09.576703 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] Created reservations ['2521deca-afc8-4c03-b228-2851823029e2'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:09.609972 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] Created reservations ['83f03e24-4536-459a-982d-0fd4afdbe68b', '75be0179-3a21-433e-8cc5-88099cab3937', '0a0e6a5c-f6e5-4872-9a53-d8b15044e6c9', '6889cd7c-eeec-40ef-abe1-375472e57819'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:09.669127 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=34 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:09.669941 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:09.726567 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:09.792916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:09.831337 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:09.835836 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-80a890f1-88fd-469a-8610-d310575e1033 tempest-GroupsV314Test-1961758143 None] Delete group completed successfully.
Oct 08 21:20:13.657809 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f48e4976-d792-44a3-8663-b94a68a51750 tempest-VolumesActionsTest-42924472 None] Acquiring lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" by "attach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:13.672046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f48e4976-d792-44a3-8663-b94a68a51750 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" acquired by "attach_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:13.723554 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f48e4976-d792-44a3-8663-b94a68a51750 tempest-VolumesActionsTest-42924472 None] Attaching volume d17c058b-5b90-4923-8332-82416b8ecefb to instance e314b928-e335-46f8-ac03-75310c970284 at mountpoint /dev/sdb on host None.
Oct 08 21:20:13.756824 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f48e4976-d792-44a3-8663-b94a68a51750 tempest-VolumesActionsTest-42924472 None] Attach volume completed successfully.
Oct 08 21:20:13.765935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f48e4976-d792-44a3-8663-b94a68a51750 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb" released by "attach_volume" :: held 0.091s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:13.949732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2e7f48fd-84ad-40e0-9427-b3b5fa159f27 tempest-VolumesActionsTest-42924472 None] Acquiring lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" by "detach_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:13.960497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2e7f48fd-84ad-40e0-9427-b3b5fa159f27 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:13.961266 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2e7f48fd-84ad-40e0-9427-b3b5fa159f27 tempest-VolumesActionsTest-42924472 None] Detaching volume d17c058b-5b90-4923-8332-82416b8ecefb from instance e314b928-e335-46f8-ac03-75310c970284.
Oct 08 21:20:14.005229 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2e7f48fd-84ad-40e0-9427-b3b5fa159f27 tempest-VolumesActionsTest-42924472 None] Detach volume completed successfully.
Oct 08 21:20:14.011955 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2e7f48fd-84ad-40e0-9427-b3b5fa159f27 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:18.909466 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-0d748aff-c0ca-410b-b4a0-0de972d0cbdb tempest-VolumesActionsTest-42924472 None] Running cmd (subprocess): rbd export --pool volumes volume-d17c058b-5b90-4923-8332-82416b8ecefb /opt/stack/data/cinder/conversion/volume-d17c058b-5b90-4923-8332-82416b8ecefb-5411403e-dc18-429f-881b-e066e303c053 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:20:19.922948 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-0d748aff-c0ca-410b-b4a0-0de972d0cbdb tempest-VolumesActionsTest-42924472 None] CMD "rbd export --pool volumes volume-d17c058b-5b90-4923-8332-82416b8ecefb /opt/stack/data/cinder/conversion/volume-d17c058b-5b90-4923-8332-82416b8ecefb-5411403e-dc18-429f-881b-e066e303c053 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.013s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:20:19.933917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.image_utils [None req-0d748aff-c0ca-410b-b4a0-0de972d0cbdb tempest-VolumesActionsTest-42924472 None] 5411403e-dc18-429f-881b-e066e303c053 was raw, no need to convert to raw {{(pid=133344) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Oct 08 21:20:29.585479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:29.617070 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (9cf30bb1-4990-42e3-8fcb-cea7bb1628ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:29.624366 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555e6515-4c98-4111-b831-6daa29c505a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.643610 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555e6515-4c98-4111-b831-6daa29c505a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-263316522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=89cdec2a-80f5-4f08-99a8-c711233e1233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948dcead48c45e8a73d309630d01966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:30Z,use_quota=True,user_id='77767a3d225c4ce98e673ca193dd01e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.649505 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d71561-5e81-454b-ad47-3821296ace84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.654822 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d71561-5e81-454b-ad47-3821296ace84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.661711 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264e42dc-2234-416c-ad3f-6da239566ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.666071 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264e42dc-2234-416c-ad3f-6da239566ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cdec2a-80f5-4f08-99a8-c711233e1233', 'volume_name': 'volume-89cdec2a-80f5-4f08-99a8-c711233e1233', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.671453 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b43205-df9e-4152-9e51-c8c0b508d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.675565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b43205-df9e-4152-9e51-c8c0b508d636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.680166 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1969faa-c2e5-486e-b910-cd2cb8b473dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.681382 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Volume 89cdec2a-80f5-4f08-99a8-c711233e1233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cdec2a-80f5-4f08-99a8-c711233e1233', 'volume_size': 1}
Oct 08 21:20:29.681866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] creating volume 'volume-89cdec2a-80f5-4f08-99a8-c711233e1233' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:29.683452 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:29.768227 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:29.768606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:29.772607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1969faa-c2e5-486e-b910-cd2cb8b473dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cdec2a-80f5-4f08-99a8-c711233e1233', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.778372 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78739615-8ba7-4f54-a0e6-8a737c391d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:29.792711 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-89cdec2a-80f5-4f08-99a8-c711233e1233 (89cdec2a-80f5-4f08-99a8-c711233e1233): created successfully
Oct 08 21:20:29.797816 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78739615-8ba7-4f54-a0e6-8a737c391d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:29.804358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (9cf30bb1-4990-42e3-8fcb-cea7bb1628ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:29.818955 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-244f584f-b7c2-458c-80de-1c37a384b055 tempest-VolumesBackupsAdminTest-1686673032 None] Created volume successfully.
Oct 08 21:20:30.891391 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:20:30Z,data_timestamp=2022-10-08T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-419381115',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5f1c0baf-7c6e-41ef-81d6-9df13e3f5ecd,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7948dcead48c45e8a73d309630d01966',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='77767a3d225c4ce98e673ca193dd01e9',volume_id=89cdec2a-80f5-4f08-99a8-c711233e1233)
Oct 08 21:20:30.892268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] continue_backup in rpcapi backup_id 5f1c0baf-7c6e-41ef-81d6-9df13e3f5ecd {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:20:31.166247 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:20:32.240767 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.074s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:20:32.244082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-89cdec2a-80f5-4f08-99a8-c711233e1233', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '89cdec2a-80f5-4f08-99a8-c711233e1233', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:20:32.268689 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] Initialize volume connection completed successfully.
Oct 08 21:20:34.658083 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] Terminate volume connection completed successfully.
Oct 08 21:20:34.733120 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5e35adef-1a28-40ab-b78f-50016cb09b59 tempest-VolumesBackupsAdminTest-1686673032 None] Remove volume export completed successfully.
Oct 08 21:20:35.940258 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['c7fd1cac-4cdc-4a65-85af-3a2e82dbcfe0', '44d83feb-c3b4-4949-8155-675ddc6e3ee2', '61d1c289-6a4e-4098-b056-a087a8b3799b', 'db24eac1-9889-48e3-a944-9e4fa0b42d4c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:36.002543 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:20:36.009254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eeabc812-0f20-473f-b89f-4507525fde0b tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-c599053f-757b-464e-8cc2-14e56f639d84-delete_snapshot" released by "delete_snapshot" :: held 30.256s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:36.130117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-385b2348-f0af-41e2-8ecc-a619742b4d79-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:36.150832 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-385b2348-f0af-41e2-8ecc-a619742b4d79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:36.152964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:37.421971 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:37.461558 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (c556e5bd-5062-424e-9587-994849959608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:37.466447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01de0b89-ee28-4662-afcd-36080a043317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.486274 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01de0b89-ee28-4662-afcd-36080a043317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:37Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5f1c0baf-7c6e-41ef-81d6-9df13e3f5ecd',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9726c8af-898a-409d-beac-b10e75d769f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948dcead48c45e8a73d309630d01966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:37Z,use_quota=True,user_id='77767a3d225c4ce98e673ca193dd01e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.491696 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf695205-1bb9-4602-a7b5-088c5b2a28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.498521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf695205-1bb9-4602-a7b5-088c5b2a28e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.503480 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acc1a7b-f477-4a75-a653-9498cd2df55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.507498 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acc1a7b-f477-4a75-a653-9498cd2df55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9726c8af-898a-409d-beac-b10e75d769f3', 'volume_name': 'volume-9726c8af-898a-409d-beac-b10e75d769f3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.521014 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3519a93b-0dc0-4076-8110-f9e9c64b9332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.525181 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3519a93b-0dc0-4076-8110-f9e9c64b9332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.531699 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85da965-2229-4931-82ca-0a465f478b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.532900 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Volume 9726c8af-898a-409d-beac-b10e75d769f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9726c8af-898a-409d-beac-b10e75d769f3', 'volume_size': 1}
Oct 08 21:20:37.533495 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] creating volume 'volume-9726c8af-898a-409d-beac-b10e75d769f3' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:37.534343 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:37.621987 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:37.622378 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:37.627466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85da965-2229-4931-82ca-0a465f478b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9726c8af-898a-409d-beac-b10e75d769f3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.633791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bdf05a-f295-4bf2-995c-0d7233cc6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:37.646890 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-9726c8af-898a-409d-beac-b10e75d769f3 (9726c8af-898a-409d-beac-b10e75d769f3): created successfully
Oct 08 21:20:37.651691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bdf05a-f295-4bf2-995c-0d7233cc6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:37.656992 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (c556e5bd-5062-424e-9587-994849959608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:37.672312 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Created volume successfully.
Oct 08 21:20:38.594335 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:20:39.630943 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.036s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:20:39.631772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9726c8af-898a-409d-beac-b10e75d769f3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '9726c8af-898a-409d-beac-b10e75d769f3', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:20:39.652110 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Initialize volume connection completed successfully.
Oct 08 21:20:40.832465 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=13,cinder:SELECT=36,cinder:INSERT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:40.834959 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=57,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:40.846526 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Terminate volume connection completed successfully.
Oct 08 21:20:40.866395 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b9a8bea8-5639-444a-9916-36650537c711 tempest-VolumesBackupsAdminTest-1686673032 None] Remove volume export completed successfully.
Oct 08 21:20:41.042525 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-0d748aff-c0ca-410b-b4a0-0de972d0cbdb tempest-VolumesActionsTest-42924472 None] Uploaded volume to glance image-id: 5411403e-dc18-429f-881b-e066e303c053. {{(pid=133344) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}}
Oct 08 21:20:41.061007 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-0d748aff-c0ca-410b-b4a0-0de972d0cbdb tempest-VolumesActionsTest-42924472 None] Copy volume to image completed successfully.
Oct 08 21:20:41.824551 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Acquiring lock "cinder-9726c8af-898a-409d-beac-b10e75d769f3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:41.835861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-9726c8af-898a-409d-beac-b10e75d769f3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:41.914262 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.066932 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-9726c8af-898a-409d-beac-b10e75d769f3 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:43.090888 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] deleting rbd volume volume-9726c8af-898a-409d-beac-b10e75d769f3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:43.098422 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Acquiring lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:43.125075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:43.210649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.311815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:20:43.312534 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Volume volume-d17c058b-5b90-4923-8332-82416b8ecefb is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:43.319575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] deleting rbd volume volume-d17c058b-5b90-4923-8332-82416b8ecefb {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:43.389944 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Created reservations ['8967bff7-2264-44ca-b2e0-c74948663359', '2fe5336e-3acb-48e6-955f-b0795bded492', '23501e50-102b-4010-92e5-e19e912eb233', '19116265-5277-4d00-90e8-fb9c8a361d28'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:43.464951 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.546761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.584876 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:43.592534 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Deleted volume successfully.
Oct 08 21:20:43.611180 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bd872a93-3499-4389-9188-ee73d6c4b670 tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-9726c8af-898a-409d-beac-b10e75d769f3-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:43.650785 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Created reservations ['65371f44-329f-4c43-854b-23ea8f31e9a9', 'c6075b7c-1e8a-495f-9f05-c2d5ebcffad2', '7cdd14e3-7eb1-4c50-bc91-ac2584420b3a', '4493c931-624f-4994-81b0-dbda883058b0'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:43.709207 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.768343 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:43.812575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:43.817210 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Deleted volume successfully.
Oct 08 21:20:43.829632 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cc578f58-4df5-4844-9b03-60ae6bde6ac5 tempest-VolumesActionsTest-42924472 None] Lock "cinder-d17c058b-5b90-4923-8332-82416b8ecefb-delete_volume" released by "delete_volume" :: held 0.705s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:45.663333 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:45.693240 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (77086024-99dc-4379-9928-82661672705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:45.702409 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d3925-2123-445b-b921-7b245dd7e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.722646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d3925-2123-445b-b921-7b245dd7e656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-2072710215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=054aac74-d20f-4a83-90a5-fc7ffb4ee4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948dcead48c45e8a73d309630d01966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:46Z,use_quota=True,user_id='77767a3d225c4ce98e673ca193dd01e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.731360 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ef1ff1-742b-4ba2-88eb-39068da10e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.735813 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ef1ff1-742b-4ba2-88eb-39068da10e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.741772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7524a3-1050-4622-a129-6ac21e900893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.746606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7524a3-1050-4622-a129-6ac21e900893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'volume_name': 'volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.751423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a80b7c3-3fee-4021-a609-4279a3e547ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.756546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a80b7c3-3fee-4021-a609-4279a3e547ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.763777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfcd4dc-c157-4b5f-8c7e-a948d70a6c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.765847 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Volume 054aac74-d20f-4a83-90a5-fc7ffb4ee4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'volume_size': 1}
Oct 08 21:20:45.766424 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] creating volume 'volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:45.767361 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:45.884881 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:45.885911 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:45.895486 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfcd4dc-c157-4b5f-8c7e-a948d70a6c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.903519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f63f1-a104-4880-9adc-9ea78f5a5e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:45.915065 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0 (054aac74-d20f-4a83-90a5-fc7ffb4ee4e0): created successfully
Oct 08 21:20:45.920188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876f63f1-a104-4880-9adc-9ea78f5a5e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:45.930197 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Flow 'volume_create_manager' (77086024-99dc-4379-9928-82661672705a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:45.941133 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-51967140-66e6-4007-a5cb-7cc17958a525 tempest-VolumesBackupsAdminTest-1686673032 None] Created volume successfully.
Oct 08 21:20:46.903125 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:20:46Z,data_timestamp=2022-10-08T21:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-676354371',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=1c8ca117-edc3-4dce-bde6-e7225bcdbb52,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7948dcead48c45e8a73d309630d01966',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='77767a3d225c4ce98e673ca193dd01e9',volume_id=054aac74-d20f-4a83-90a5-fc7ffb4ee4e0)
Oct 08 21:20:46.904948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] continue_backup in rpcapi backup_id 1c8ca117-edc3-4dce-bde6-e7225bcdbb52 {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:20:47.113419 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:20:48.009901 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.896s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:20:48.011592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '054aac74-d20f-4a83-90a5-fc7ffb4ee4e0', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:20:48.029474 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] Initialize volume connection completed successfully.
Oct 08 21:20:48.414875 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:20:48.435430 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (e7eddbb5-a451-45b7-a295-777308d977b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:48.441796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace318a3-50a0-490f-8511-fc262d9c8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.458733 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace318a3-50a0-490f-8511-fc262d9c8192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1040276124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d763bbc7-78ba-482f-883e-5cbff5953069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238ac8ac5e4e7793c1ebb53a85eaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:20:48Z,use_quota=True,user_id='a009ac77727640de9becf6a61c8f1662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.463904 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e792ce-c09e-4870-ad62-f77dfa5aca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.467873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e792ce-c09e-4870-ad62-f77dfa5aca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.472685 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed5db9-bbd4-4634-a26f-3bb7e9ac45dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.476795 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ed5db9-bbd4-4634-a26f-3bb7e9ac45dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd763bbc7-78ba-482f-883e-5cbff5953069', 'volume_name': 'volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.481884 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136649b5-3182-4bfe-a6c0-db5e806b139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.485842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136649b5-3182-4bfe-a6c0-db5e806b139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.490313 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a868cee2-ecda-4e69-ac44-170d9560b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.491385 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Volume d763bbc7-78ba-482f-883e-5cbff5953069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'volume_size': 1}
Oct 08 21:20:48.491794 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] creating volume 'volume-d763bbc7-78ba-482f-883e-5cbff5953069' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:20:48.492947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:48.544005 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:20:48.544407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:20:48.548095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a868cee2-ecda-4e69-ac44-170d9560b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.552545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234d1983-f88b-47b2-a0b6-9f91390178a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:20:48.563063 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Volume volume-d763bbc7-78ba-482f-883e-5cbff5953069 (d763bbc7-78ba-482f-883e-5cbff5953069): created successfully
Oct 08 21:20:48.566508 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234d1983-f88b-47b2-a0b6-9f91390178a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:20:48.572553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (e7eddbb5-a451-45b7-a295-777308d977b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:20:48.582581 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-36c45e8d-fe4f-45a3-a717-eff598706b25 tempest-VolumesBackupsTest-825618197 None] Created volume successfully.
Oct 08 21:20:50.307876 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] Terminate volume connection completed successfully.
Oct 08 21:20:50.326076 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ee9f6f46-b0cf-4259-99dd-71353df0ebbe tempest-VolumesBackupsAdminTest-1686673032 None] Remove volume export completed successfully.
Oct 08 21:20:53.400598 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Acquiring lock "cinder-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:53.413464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:53.454335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:54.179192 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:54.195124 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] deleting rbd volume volume-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:54.445602 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Created reservations ['a9004429-1e25-4480-9ca9-ff26f6f43486', '57bcb7be-5fe0-4110-96fd-d9f04f66f462', 'abba42f0-4f36-4a3e-8a80-bf960c95e1ab', '30845298-ccc6-4de5-a5e5-044b14b1859f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:54.493926 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:54.505009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:54.547258 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:54.593942 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:54.611259 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Deleted volume successfully.
Oct 08 21:20:54.629134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Acquiring lock "cinder-89cdec2a-80f5-4f08-99a8-c711233e1233-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:20:54.641934 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-89cdec2a-80f5-4f08-99a8-c711233e1233-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:20:54.675966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:55.181839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Volume volume-89cdec2a-80f5-4f08-99a8-c711233e1233 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:20:55.193509 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] deleting rbd volume volume-89cdec2a-80f5-4f08-99a8-c711233e1233 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:20:55.195500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-61870b26-2bb2-47e4-9486-72395d3ca518 tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-054aac74-d20f-4a83-90a5-fc7ffb4ee4e0-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:20:55.377268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Created reservations ['bc7a8757-2e53-48a7-9562-61ad6801689f', 'e598ee07-d2f3-415a-bcc7-bd3b28ac574c', '94be4fa0-1c2d-4047-9dce-7519550d25ba', '024b6b89-6151-47c0-8fbe-90b1ef42ebaa'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:20:55.392872 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=60,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:20:55.424607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:55.451356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:20:55.479702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:20:55.484233 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Deleted volume successfully.
Oct 08 21:20:55.499536 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a8cb94e-f90e-4961-ad55-d5c07526243b tempest-VolumesBackupsAdminTest-1686673032 None] Lock "cinder-89cdec2a-80f5-4f08-99a8-c711233e1233-delete_volume" released by "delete_volume" :: held 0.858s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:00.321366 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:00.341002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Flow 'volume_create_manager' (8b45872a-0124-4db0-bfac-dfd184fbe985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:00.347140 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0de8c75-5611-4276-baeb-aa802321849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:00.363005 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0de8c75-5611-4276-baeb-aa802321849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-645229999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a191c344-644b-41a4-aeee-da7c621274d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f78840b82af409ea762c732520aee70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:00Z,use_quota=True,user_id='c11f3e3284a346bcbcf0099c0a9bed7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:00.368112 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7dcd62-f481-47c4-9806-10bde616e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:00.372773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7dcd62-f481-47c4-9806-10bde616e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:00.377596 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327798c7-5104-48a9-94fe-a33ae6e068e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:00.464742 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327798c7-5104-48a9-94fe-a33ae6e068e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a191c344-644b-41a4-aeee-da7c621274d3', 'volume_name': 'volume-a191c344-644b-41a4-aeee-da7c621274d3', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a2d00d0>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:00.469474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171d4d26-1854-4ec0-9299-af8b32615879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:00.473308 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171d4d26-1854-4ec0-9299-af8b32615879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:00.477796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e146f572-3248-4f47-b2c4-5284e9ef7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:00.479757 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Volume a191c344-644b-41a4-aeee-da7c621274d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a191c344-644b-41a4-aeee-da7c621274d3', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a2d00d0>}
Oct 08 21:21:00.480563 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Cloning a191c344-644b-41a4-aeee-da7c621274d3 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:21:00.481564 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:00.496545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:00.508339 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 0, 503252)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:00.511169 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:00.511624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:21:00.516892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:00.517941 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:21:00.523992 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 0, 521639)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:00.524467 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:00.524857 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:21:00.538600 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:00.609290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] creating snapshot='volume-a191c344-644b-41a4-aeee-da7c621274d3.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:01.117665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-a191c344-644b-41a4-aeee-da7c621274d3.clone_snap' to 'volume-a191c344-644b-41a4-aeee-da7c621274d3' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:01.251677 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:01.252884 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:01.253229 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:01.270977 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:01.271868 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Marking volume a191c344-644b-41a4-aeee-da7c621274d3 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:21:01.280996 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to a191c344-644b-41a4-aeee-da7c621274d3. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:21:01.281520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Creating volume glance metadata for volume a191c344-644b-41a4-aeee-da7c621274d3 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:21:01.352086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e146f572-3248-4f47-b2c4-5284e9ef7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a191c344-644b-41a4-aeee-da7c621274d3', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3a2d00d0>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:01.357577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7d6392-1261-4d09-a9ce-97e6eab37dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:01.369812 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Volume volume-a191c344-644b-41a4-aeee-da7c621274d3 (a191c344-644b-41a4-aeee-da7c621274d3): created successfully
Oct 08 21:21:01.379456 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7d6392-1261-4d09-a9ce-97e6eab37dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:01.384761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Flow 'volume_create_manager' (8b45872a-0124-4db0-bfac-dfd184fbe985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:01.394385 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-209b2b31-5eb8-4d63-814d-fa94ca568e0f tempest-VolumesImageMetadata-836684208 None] Created volume successfully.
Oct 08 21:21:02.783312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Acquiring lock "cinder-a191c344-644b-41a4-aeee-da7c621274d3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:02.797462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Lock "cinder-a191c344-644b-41a4-aeee-da7c621274d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:02.848229 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:02.921635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:02.928071 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] deleting rbd volume volume-a191c344-644b-41a4-aeee-da7c621274d3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:03.153521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:03.191726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] deleting parent snapshot volume-a191c344-644b-41a4-aeee-da7c621274d3.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:04.195168 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-289485ba-e412-42bd-9ecd-db7ad41d048b req-1d4d366d-32e5-4bcd-9916-32730d20049d tempest-VolumesBackupsTest-825618197 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:21:04.246796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Created reservations ['37680ca7-b7f9-4557-80bd-6115795d2513', '086f26fe-0c03-4a94-a893-fce8dda3b564', '92dfb2c0-fb73-4809-bb34-ee53ced8ef16', 'dca3ffe3-0e29-4d6e-9c61-c6e1531c13f5'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:04.300348 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:04.344453 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:04.389698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:04.394881 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Deleted volume successfully.
Oct 08 21:21:04.409036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eb81f691-b925-4c45-bd29-cc67f710ec4a tempest-VolumesImageMetadata-836684208 None] Lock "cinder-a191c344-644b-41a4-aeee-da7c621274d3-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:04.959953 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-289485ba-e412-42bd-9ecd-db7ad41d048b req-1d4d366d-32e5-4bcd-9916-32730d20049d tempest-VolumesBackupsTest-825618197 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:21:04.960524 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-289485ba-e412-42bd-9ecd-db7ad41d048b req-1d4d366d-32e5-4bcd-9916-32730d20049d tempest-VolumesBackupsTest-825618197 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd763bbc7-78ba-482f-883e-5cbff5953069', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:21:04.990540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-289485ba-e412-42bd-9ecd-db7ad41d048b req-1d4d366d-32e5-4bcd-9916-32730d20049d tempest-VolumesBackupsTest-825618197 None] Connection info returned from driver {'name': 'volumes/volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd763bbc7-78ba-482f-883e-5cbff5953069', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '34d8953a-8116-4ebb-9c44-6c333148a295'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:21:05.058481 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-289485ba-e412-42bd-9ecd-db7ad41d048b req-1d4d366d-32e5-4bcd-9916-32730d20049d tempest-VolumesBackupsTest-825618197 None] attachment_update completed successfully.
Oct 08 21:21:05.956178 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:21:05.957018 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:06.007045 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:06.060500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:06.421311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['47135f7a-064f-4a11-bce5-0fa5c3a4ecbb', 'c328fd80-f703-4c2a-981b-a920470e3ce3', '79268623-2570-4bfc-8af0-f912c6cc0f82', '01c97872-8496-4630-a0dc-59b86f87b34b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:06.466312 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=27,cinder:INSERT=11 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:06.492462 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:21:06.500440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-53e88779-cb6d-4810-aee7-718a435b16b5 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-385b2348-f0af-41e2-8ecc-a619742b4d79-delete_snapshot" released by "delete_snapshot" :: held 30.350s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:07.797754 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:21:07Z,data_timestamp=2022-10-08T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1061966409',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=20a5627b-e54c-4af0-9169-162476d03f78,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='fd238ac8ac5e4e7793c1ebb53a85eaef',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a009ac77727640de9becf6a61c8f1662',volume_id=d763bbc7-78ba-482f-883e-5cbff5953069)
Oct 08 21:21:07.799276 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] continue_backup in rpcapi backup_id 20a5627b-e54c-4af0-9169-162476d03f78 {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:21:07.915987 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:21:08.429637 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 req-ae44b997-5134-4e54-9e7b-5fdebe2a14ae tempest-VolumesSnapshotTestJSON-547814895 None] Terminate volume connection completed successfully.
Oct 08 21:21:08.430127 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a1cfefdd-02b5-418c-8ab9-16b047f7d7e3 req-ae44b997-5134-4e54-9e7b-5fdebe2a14ae tempest-VolumesSnapshotTestJSON-547814895 None] Deleting attachment 6791bc35-382d-43b7-8be0-3cc8c7981cc0. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:21:08.501098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:08.525317 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Flow 'volume_create_manager' (312b5bad-79cd-4a0c-89d2-96e57f4d69c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:08.533040 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0629ffa7-71fe-47bb-a596-2ccbdfc37a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.558617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0629ffa7-71fe-47bb-a596-2ccbdfc37a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2051446394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=68788704-cdbe-4e67-894b-c64c031cb21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c598da07d04b78bb32164d4e25d0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:08Z,use_quota=True,user_id='ad60755620514bea97406f99d69339bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.565935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dedb88-fb9e-4b48-8068-ba0fc416bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.571311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dedb88-fb9e-4b48-8068-ba0fc416bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.576827 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71ae88c-a4bb-40e1-9d34-8be6e287292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.581020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71ae88c-a4bb-40e1-9d34-8be6e287292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68788704-cdbe-4e67-894b-c64c031cb21d', 'volume_name': 'volume-68788704-cdbe-4e67-894b-c64c031cb21d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.586671 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3f4c2-b581-4555-a847-ebcfc307eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.591690 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3f4c2-b581-4555-a847-ebcfc307eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.596569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd962ab9-8e45-436a-a678-31b67d9d5c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.597692 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Volume 68788704-cdbe-4e67-894b-c64c031cb21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68788704-cdbe-4e67-894b-c64c031cb21d', 'volume_size': 1}
Oct 08 21:21:08.598110 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] creating volume 'volume-68788704-cdbe-4e67-894b-c64c031cb21d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:08.599303 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:08.679498 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:08.680117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:08.685159 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd962ab9-8e45-436a-a678-31b67d9d5c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68788704-cdbe-4e67-894b-c64c031cb21d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.691033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c027a9-6045-4cf4-87ef-4e521c90050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:08.705432 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Volume volume-68788704-cdbe-4e67-894b-c64c031cb21d (68788704-cdbe-4e67-894b-c64c031cb21d): created successfully
Oct 08 21:21:08.710674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c027a9-6045-4cf4-87ef-4e521c90050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:08.718020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Flow 'volume_create_manager' (312b5bad-79cd-4a0c-89d2-96e57f4d69c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:08.736637 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2258833a-6189-4830-9362-5b177267cd91 tempest-VolumesTransfersV355Test-481942589 None] Created volume successfully.
Oct 08 21:21:08.750963 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:21:08.751758 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d763bbc7-78ba-482f-883e-5cbff5953069', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd763bbc7-78ba-482f-883e-5cbff5953069', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:21:08.776154 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] Initialize volume connection completed successfully.
Oct 08 21:21:10.083646 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-0653e319-081d-4fb5-a40a-84bcc3f061a7 tempest-VolumesTransfersV355Test-1113740660 None] Transfer volume completed successfully.
Oct 08 21:21:10.491176 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] Terminate volume connection completed successfully.
Oct 08 21:21:10.519071 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93dedaf5-27e7-4011-b543-4b7aeaecf7e9 tempest-VolumesBackupsTest-825618197 None] Remove volume export completed successfully.
Oct 08 21:21:10.711974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Acquiring lock "cinder-68788704-cdbe-4e67-894b-c64c031cb21d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:10.725967 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Lock "cinder-68788704-cdbe-4e67-894b-c64c031cb21d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:10.769879 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=24,cinder:SELECT=61,cinder:DELETE=4,cinder:INSERT=11 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:10.769879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:10.830605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:10.831126 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Volume volume-68788704-cdbe-4e67-894b-c64c031cb21d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:10.838688 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] deleting rbd volume volume-68788704-cdbe-4e67-894b-c64c031cb21d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:11.133683 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Created reservations ['dbe6f3a7-8a3e-4645-a463-d7cb85a1bd1c', 'b589265d-9a8b-4f91-b74a-44e54924cc02', '91f03723-f769-42f7-bf55-061a370d6aad', 'd8e0d2d3-b432-4249-a09b-8f74ff3d63a7'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:11.183216 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:11.257323 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:11.305738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:11.311758 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Deleted volume successfully.
Oct 08 21:21:11.328294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93e502f1-1c16-40b8-a372-c586d75fac23 tempest-VolumesTransfersV355Test-1691897343 None] Lock "cinder-68788704-cdbe-4e67-894b-c64c031cb21d-delete_volume" released by "delete_volume" :: held 0.602s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:12.242115 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:12.274637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Flow 'volume_create_manager' (f1c1bb08-784f-4a0d-ac00-975fe07fd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:12.283121 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cce0fa-4c58-4d9a-a6f3-2313b6026940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.306093 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cce0fa-4c58-4d9a-a6f3-2313b6026940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-202568050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4c1ceb0-a5be-4825-960a-3cbed87a82f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c598da07d04b78bb32164d4e25d0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:12Z,use_quota=True,user_id='ad60755620514bea97406f99d69339bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.313554 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e52847-54d0-4124-bb19-0fa112fff43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.319228 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e52847-54d0-4124-bb19-0fa112fff43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.326269 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f1f2a-6610-403e-9969-144a3d8c73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.347086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f1f2a-6610-403e-9969-144a3d8c73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c1ceb0-a5be-4825-960a-3cbed87a82f4', 'volume_name': 'volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.352877 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d163252-e8fd-4141-aa1a-b246dfcb0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.357092 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d163252-e8fd-4141-aa1a-b246dfcb0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.367501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349e78f7-f09d-4f26-8b95-53b3aa81bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.370566 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Volume a4c1ceb0-a5be-4825-960a-3cbed87a82f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4', 'volume_size': 1}
Oct 08 21:21:12.370980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] creating volume 'volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:12.372343 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:12.466482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:12.466865 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:12.470690 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349e78f7-f09d-4f26-8b95-53b3aa81bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.477513 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bc57c-79d6-4e37-aae0-1237afb12671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:12.491120 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Volume volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4 (a4c1ceb0-a5be-4825-960a-3cbed87a82f4): created successfully
Oct 08 21:21:12.496366 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bc57c-79d6-4e37-aae0-1237afb12671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:12.502182 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Flow 'volume_create_manager' (f1c1bb08-784f-4a0d-ac00-975fe07fd52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:12.513963 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5e18cbbd-1152-43d0-9c4b-011bd600de53 tempest-VolumesTransfersV355Test-481942589 None] Created volume successfully.
Oct 08 21:21:12.994366 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:13.042421 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (8cc940d7-0031-4301-867b-f35cfe88a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:13.052384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d186bd-bf28-461c-9d44-b1ce84a06750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.075646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d186bd-bf28-461c-9d44-b1ce84a06750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1773825271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a80d8d0-8d40-4284-b7b0-342612a3b2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:13Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.081313 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ab81a0-5cf2-46e0-8168-50d910df94bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.085378 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ab81a0-5cf2-46e0-8168-50d910df94bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.090828 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41402e16-5b81-4fbf-a8dd-3fa18f9e1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.094834 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41402e16-5b81-4fbf-a8dd-3fa18f9e1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a80d8d0-8d40-4284-b7b0-342612a3b2b4', 'volume_name': 'volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.099606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c778e0-7603-4a7a-8bc0-8fcec0b1abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.103690 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c778e0-7603-4a7a-8bc0-8fcec0b1abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.109571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dcba71-bccf-4d40-a897-61592616170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.111044 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Volume 6a80d8d0-8d40-4284-b7b0-342612a3b2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4', 'volume_size': 1}
Oct 08 21:21:13.111446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] creating volume 'volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:13.112081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:13.222082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:13.222666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:13.226768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dcba71-bccf-4d40-a897-61592616170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.232313 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc5cf8d-e487-4dac-9664-6237a4aedb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:13.255697 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-0615cffd-6830-42c2-b2e8-86da0770f1cf req-4da7fc47-7ab1-49e8-b26c-e4e36b2cc994 tempest-VolumesBackupsTest-825618197 None] Terminate volume connection completed successfully.
Oct 08 21:21:13.256335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-0615cffd-6830-42c2-b2e8-86da0770f1cf req-4da7fc47-7ab1-49e8-b26c-e4e36b2cc994 tempest-VolumesBackupsTest-825618197 None] Deleting attachment 34d8953a-8116-4ebb-9c44-6c333148a295. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:21:13.261544 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4 (6a80d8d0-8d40-4284-b7b0-342612a3b2b4): created successfully
Oct 08 21:21:13.269754 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc5cf8d-e487-4dac-9664-6237a4aedb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:13.289061 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (8cc940d7-0031-4301-867b-f35cfe88a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:13.313264 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ade8bae2-7772-4ab9-a98f-92ec778659f3 tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:21:13.697382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Acquiring lock "cinder-a4c1ceb0-a5be-4825-960a-3cbed87a82f4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:13.718605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Lock "cinder-a4c1ceb0-a5be-4825-960a-3cbed87a82f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:13.767437 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:13.826562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:13.828024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Volume volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:13.833562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] deleting rbd volume volume-a4c1ceb0-a5be-4825-960a-3cbed87a82f4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:14.129295 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Created reservations ['cd38ad67-1ff4-4e51-8ae6-ab37c2e96ac8', 'ba59c84a-5fda-4b6c-a334-f90032289ce6', '5fa1b697-e209-4d3f-a3c8-214d6300ccee', 'bcce3d51-5361-41ab-a434-13240ea37207'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:14.206638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:14.313891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:14.379282 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:14.391796 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Deleted volume successfully.
Oct 08 21:21:14.421646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-843e03c7-f11c-456e-8f01-4e7197eeaa07 tempest-VolumesTransfersV355Test-1691897343 None] Lock "cinder-a4c1ceb0-a5be-4825-960a-3cbed87a82f4-delete_volume" released by "delete_volume" :: held 0.703s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:14.424024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1f70b3ab-049c-4a56-afdc-11178474b64e tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:15.429036 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1f70b3ab-049c-4a56-afdc-11178474b64e tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:21:16.187215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:16.218650 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (0ab3b581-d212-4488-b100-bc2ab6a5c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:16.225807 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a508549a-72cc-4b75-853f-948056da00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.243512 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a508549a-72cc-4b75-853f-948056da00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-794951697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=90d6e166-e12c-4080-8d74-a5151428abb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2e7b8d7b-3baa-4bf8-8bdb-e424e846360b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:16Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.249130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e480801-2d31-42d0-8aa6-efc72dc7c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.253452 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e480801-2d31-42d0-8aa6-efc72dc7c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.259416 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a10a73-6316-4964-ad52-97cbbabccb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.263698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a10a73-6316-4964-ad52-97cbbabccb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90d6e166-e12c-4080-8d74-a5151428abb5', 'volume_name': 'volume-90d6e166-e12c-4080-8d74-a5151428abb5', 'volume_size': 2, 'snapshot_id': '2e7b8d7b-3baa-4bf8-8bdb-e424e846360b'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.268462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4218f31d-3846-43b2-91cb-dec7916b9881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.272238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4218f31d-3846-43b2-91cb-dec7916b9881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.277634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a3fcf7-9233-48d5-add5-c75cdf6624d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.279020 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Volume 90d6e166-e12c-4080-8d74-a5151428abb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90d6e166-e12c-4080-8d74-a5151428abb5', 'volume_size': 2, 'snapshot_id': '2e7b8d7b-3baa-4bf8-8bdb-e424e846360b'}
Oct 08 21:21:16.305288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] cloning volumes/volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4@snapshot-2e7b8d7b-3baa-4bf8-8bdb-e424e846360b to volume-90d6e166-e12c-4080-8d74-a5151428abb5 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:21:16.305926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:16.375672 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:16.535106 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:16.535767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:16.547497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:16.772206 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a3fcf7-9233-48d5-add5-c75cdf6624d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d6e166-e12c-4080-8d74-a5151428abb5', 'volume_size': 2, 'snapshot_id': '2e7b8d7b-3baa-4bf8-8bdb-e424e846360b'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.780643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac844cd-f59b-484a-93a2-1cd1378677a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:16.793643 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-90d6e166-e12c-4080-8d74-a5151428abb5 (90d6e166-e12c-4080-8d74-a5151428abb5): created successfully
Oct 08 21:21:16.798440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac844cd-f59b-484a-93a2-1cd1378677a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:16.805388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (0ab3b581-d212-4488-b100-bc2ab6a5c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:16.828428 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3d5195ed-eebb-479a-8f96-273207ae638c tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:21:17.437535 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-90d6e166-e12c-4080-8d74-a5151428abb5-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:17.466474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-90d6e166-e12c-4080-8d74-a5151428abb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:17.540547 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:17.656077 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:17.663694 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-90d6e166-e12c-4080-8d74-a5151428abb5 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:18.008557 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['385f5107-4ac2-469e-8508-741c59fc711b', '81ba03db-5994-4c9d-9388-55a1b543d5cb', '72f8877d-9588-43d0-871b-da66506ccaf8', '9c52f4c9-7f2b-49c1-831d-f8bea7859f37'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:18.024478 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:18.063592 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:18.079870 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:18.141245 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:18.207778 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:18.218202 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:18.250079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-94f2bcd4-2bf4-485e-8503-aa0062d529bb tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-90d6e166-e12c-4080-8d74-a5151428abb5-delete_volume" released by "delete_volume" :: held 0.784s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:18.822135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Acquiring lock "cinder-d763bbc7-78ba-482f-883e-5cbff5953069-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:18.850233 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-d763bbc7-78ba-482f-883e-5cbff5953069-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:18.928433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:19.367006 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Volume volume-d763bbc7-78ba-482f-883e-5cbff5953069 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:19.379918 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] deleting rbd volume volume-d763bbc7-78ba-482f-883e-5cbff5953069 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:19.406211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:19.431540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (57fe4665-3098-416d-b570-2c7f74270e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:19.441726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a544a515-3993-4c2c-aacb-3f9edf793d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.460249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a544a515-3993-4c2c-aacb-3f9edf793d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735463202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=933cba9a-f631-4d45-a147-99986beb05e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:19Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.466482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3f65d1-9d98-4176-af46-373ab862b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.471309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3f65d1-9d98-4176-af46-373ab862b99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.477244 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31481221-44fa-431e-a005-3f0ab8d236b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.485251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31481221-44fa-431e-a005-3f0ab8d236b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933cba9a-f631-4d45-a147-99986beb05e4', 'volume_name': 'volume-933cba9a-f631-4d45-a147-99986beb05e4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.490408 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d003ddad-2923-4899-8aa8-872321f8d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.495234 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d003ddad-2923-4899-8aa8-872321f8d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.500069 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b416a8d-8a9a-4e3f-bfeb-f5e3449dc21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.501692 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Volume 933cba9a-f631-4d45-a147-99986beb05e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933cba9a-f631-4d45-a147-99986beb05e4', 'volume_size': 1}
Oct 08 21:21:19.502344 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] creating volume 'volume-933cba9a-f631-4d45-a147-99986beb05e4' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:19.503316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:19.611487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:19.611941 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:19.616869 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b416a8d-8a9a-4e3f-bfeb-f5e3449dc21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933cba9a-f631-4d45-a147-99986beb05e4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.622386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176dfdbe-0107-472f-a9a9-1f9f27f2b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:19.646716 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-933cba9a-f631-4d45-a147-99986beb05e4 (933cba9a-f631-4d45-a147-99986beb05e4): created successfully
Oct 08 21:21:19.650710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176dfdbe-0107-472f-a9a9-1f9f27f2b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:19.657284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (57fe4665-3098-416d-b570-2c7f74270e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:19.673741 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Created reservations ['b36a2446-2f3f-472a-8e4b-c9b6579c7a09', '9c0facf1-3e2f-4267-9a0f-63a0c1f2be0e', 'a74fd48d-7b20-46ac-936a-529cf2966931', '2dc46b3b-16bc-4bc7-849f-a75e35a4fdad'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:19.681209 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a3f5dfd6-0be4-45d3-9667-b8b42439b745 tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:21:19.753816 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:19.799755 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:19.860392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:19.867544 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Deleted volume successfully.
Oct 08 21:21:19.886847 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-074675c2-fa90-480a-ae60-b2bd1d3c8324 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-d763bbc7-78ba-482f-883e-5cbff5953069-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:20.728213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:20.756838 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Flow 'volume_create_manager' (add99fed-42d3-4982-b8e3-a6ef109166c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:20.767144 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ea1aa7-ba28-4e81-8993-5bc5cd3033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.803753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ea1aa7-ba28-4e81-8993-5bc5cd3033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1452943454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9451e2f2-f0e1-47c2-8884-972fd31d61cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2000b1ff979408fb623e3160ada9e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:21Z,use_quota=True,user_id='985e9bc4d4674a2b8b8e98807eca3db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.809508 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71d1a3b-cfaa-4a25-ae91-b98bf50c2be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.813732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71d1a3b-cfaa-4a25-ae91-b98bf50c2be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.818621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c2c6a-af48-4c8a-b1dc-6789442c7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.823187 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c2c6a-af48-4c8a-b1dc-6789442c7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'volume_name': 'volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.832067 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043d1559-d6ee-4b1a-9c3a-8894b5a3bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.832769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043d1559-d6ee-4b1a-9c3a-8894b5a3bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.838494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e7873d-b78d-4a38-a960-5de65859ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.839697 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Volume 9451e2f2-f0e1-47c2-8884-972fd31d61cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'volume_size': 1}
Oct 08 21:21:20.840089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] creating volume 'volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:20.840849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:20.891661 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:20.918919 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (d455f6b5-ad56-4dc5-bf15-74e8ff692300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:20.925141 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec76396-0a19-4535-b7a8-46d02c3e440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.934658 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:20.935034 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:20.938617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e7873d-b78d-4a38-a960-5de65859ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.942972 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf8ef2-c333-4316-b504-188a8bcc9d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.964535 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec76396-0a19-4535-b7a8-46d02c3e440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-26990792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0150664-2751-424e-864a-43eb2b72a4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238ac8ac5e4e7793c1ebb53a85eaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:21Z,use_quota=True,user_id='a009ac77727640de9becf6a61c8f1662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.970099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf69cf27-5fec-4e15-874b-c257f1c7ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.974098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf69cf27-5fec-4e15-874b-c257f1c7ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.979806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede739cf-380c-4f5c-85ef-9ea58aa13a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:20.989509 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Volume volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb (9451e2f2-f0e1-47c2-8884-972fd31d61cb): created successfully
Oct 08 21:21:20.993506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf8ef2-c333-4316-b504-188a8bcc9d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:20.999435 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Flow 'volume_create_manager' (add99fed-42d3-4982-b8e3-a6ef109166c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:21.016070 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dfd3573d-dd92-40a2-9346-c8a90a239aa0 tempest-VolumesBackupsV39Test-911242546 None] Created volume successfully.
Oct 08 21:21:21.033903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ccdd14e3-224c-4508-9327-b598b0f82f87 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:21.107911 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede739cf-380c-4f5c-85ef-9ea58aa13a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0150664-2751-424e-864a-43eb2b72a4cf', 'volume_name': 'volume-e0150664-2751-424e-864a-43eb2b72a4cf', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236040>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:21.112876 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675837b-c2af-4157-bcde-9f0b08c63c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:21.116907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675837b-c2af-4157-bcde-9f0b08c63c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:21.122103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86dcbd2c-1002-405a-bc23-a7981824526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:21.123202 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Volume e0150664-2751-424e-864a-43eb2b72a4cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0150664-2751-424e-864a-43eb2b72a4cf', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236040>}
Oct 08 21:21:21.123765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Cloning e0150664-2751-424e-864a-43eb2b72a4cf from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:21:21.124530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:21.132257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:21.142409 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 21, 137047)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:21.142876 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:21.143257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:21:21.147761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:21.148722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:21:21.158103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 21, 153034)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:21.158103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:21.158103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:21:21.169074 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:21.222037 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] creating snapshot='volume-e0150664-2751-424e-864a-43eb2b72a4cf.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:21.422221 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-e0150664-2751-424e-864a-43eb2b72a4cf.clone_snap' to 'volume-e0150664-2751-424e-864a-43eb2b72a4cf' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:21.497481 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ccdd14e3-224c-4508-9327-b598b0f82f87 tempest-VolumesSnapshotTestJSON-547814895 None] Create snapshot completed successfully
Oct 08 21:21:21.599323 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:21.601787 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:21.602286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:21.617997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:21.618853 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Marking volume e0150664-2751-424e-864a-43eb2b72a4cf as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:21:21.628429 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to e0150664-2751-424e-864a-43eb2b72a4cf. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:21:21.628892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Creating volume glance metadata for volume e0150664-2751-424e-864a-43eb2b72a4cf backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:21:21.736401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86dcbd2c-1002-405a-bc23-a7981824526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0150664-2751-424e-864a-43eb2b72a4cf', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236040>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:21.743552 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df83b61-9417-40fa-8ed8-9f6677166bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:21.773060 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Volume volume-e0150664-2751-424e-864a-43eb2b72a4cf (e0150664-2751-424e-864a-43eb2b72a4cf): created successfully
Oct 08 21:21:21.782549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df83b61-9417-40fa-8ed8-9f6677166bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:21.787905 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (d455f6b5-ad56-4dc5-bf15-74e8ff692300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:21.799460 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8521eb30-20ff-478a-ab4b-1f303a94b5b8 tempest-VolumesBackupsTest-825618197 None] Created volume successfully.
Oct 08 21:21:22.025281 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:21:21Z,data_timestamp=2022-10-08T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-175641449',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9fe96d27-23fd-4195-b6db-dbd07e9f3f48,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b2000b1ff979408fb623e3160ada9e63',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='985e9bc4d4674a2b8b8e98807eca3db6',volume_id=9451e2f2-f0e1-47c2-8884-972fd31d61cb)
Oct 08 21:21:22.028713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] continue_backup in rpcapi backup_id 9fe96d27-23fd-4195-b6db-dbd07e9f3f48 {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:21:22.171438 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:21:22.512551 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:22.563127 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (03ee6cb2-0b4d-43ed-bb16-6800ff1292a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:22.569675 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf16f10f-83a9-497a-8590-9776c037fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:22.596400 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf16f10f-83a9-497a-8590-9776c037fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707017915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=88e6920f-5a55-40ea-a0b0-37ab98048216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdea37d91ed431aa0dc780148174e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edde487d-24f6-4887-afdb-2fe3efaa5dac,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:22Z,use_quota=True,user_id='3a292ffe2c5c41ef8d281fa525792b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:22.603134 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb966bf-4e0d-47c9-9646-019a26975f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:22.609661 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb966bf-4e0d-47c9-9646-019a26975f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:22.617096 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c013f-91ca-4545-984b-b0757bb08db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:22.622633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c013f-91ca-4545-984b-b0757bb08db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88e6920f-5a55-40ea-a0b0-37ab98048216', 'volume_name': 'volume-88e6920f-5a55-40ea-a0b0-37ab98048216', 'volume_size': 1, 'snapshot_id': 'edde487d-24f6-4887-afdb-2fe3efaa5dac'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:22.628202 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11850916-fe43-4b02-ba8b-e0e34a85b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:22.632369 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11850916-fe43-4b02-ba8b-e0e34a85b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:22.638067 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca52a48-a9e5-4523-9a71-916745e46b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:22.639417 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Volume 88e6920f-5a55-40ea-a0b0-37ab98048216: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88e6920f-5a55-40ea-a0b0-37ab98048216', 'volume_size': 1, 'snapshot_id': 'edde487d-24f6-4887-afdb-2fe3efaa5dac'}
Oct 08 21:21:22.664565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] cloning volumes/volume-933cba9a-f631-4d45-a147-99986beb05e4@snapshot-edde487d-24f6-4887-afdb-2fe3efaa5dac to volume-88e6920f-5a55-40ea-a0b0-37ab98048216 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:21:22.666679 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:22.744764 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:22.967621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:22.970653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:23.006410 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca52a48-a9e5-4523-9a71-916745e46b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e6920f-5a55-40ea-a0b0-37ab98048216', 'volume_size': 1, 'snapshot_id': 'edde487d-24f6-4887-afdb-2fe3efaa5dac'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:23.020799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d390b-c0a4-4c1d-9e4c-9ddfae486d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:23.038362 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-88e6920f-5a55-40ea-a0b0-37ab98048216 (88e6920f-5a55-40ea-a0b0-37ab98048216): created successfully
Oct 08 21:21:23.049713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d390b-c0a4-4c1d-9e4c-9ddfae486d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:23.058674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Flow 'volume_create_manager' (03ee6cb2-0b4d-43ed-bb16-6800ff1292a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:23.109886 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-666374be-348d-4f22-b754-7447dc7bd37e tempest-VolumesSnapshotTestJSON-547814895 None] Created volume successfully.
Oct 08 21:21:23.215639 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.044s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:21:23.216218 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '9451e2f2-f0e1-47c2-8884-972fd31d61cb', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:21:23.235696 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] Initialize volume connection completed successfully.
Oct 08 21:21:23.365732 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:21:23Z,data_timestamp=2022-10-08T21:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1855655406',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d179c255-9aee-4b06-a56b-308da55f99e1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='fd238ac8ac5e4e7793c1ebb53a85eaef',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a009ac77727640de9becf6a61c8f1662',volume_id=e0150664-2751-424e-864a-43eb2b72a4cf)
Oct 08 21:21:23.366770 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] continue_backup in rpcapi backup_id d179c255-9aee-4b06-a56b-308da55f99e1 {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:21:23.548869 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:21:23.733738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-88e6920f-5a55-40ea-a0b0-37ab98048216-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:23.790115 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-88e6920f-5a55-40ea-a0b0-37ab98048216-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:23.872899 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=25,cinder:SELECT=66,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:23.878765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:23.959830 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:23.966644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-88e6920f-5a55-40ea-a0b0-37ab98048216 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:24.201740 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['b4683e22-b97b-4ba7-82ec-b74a661879a1', '5eb1e52b-3afc-4983-8259-247b7574e0b9', '69615778-5ec9-4bd7-b40e-ff9b0843ba89', 'ba134a60-3eb4-46e8-bfef-9853161f43bd'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:24.267765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:24.305048 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:24.347552 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:24.358076 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:24.377416 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2651e11d-86b1-483a-b8c7-3fb402790faa tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-88e6920f-5a55-40ea-a0b0-37ab98048216-delete_volume" released by "delete_volume" :: held 0.589s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:24.559949 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.011s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:21:24.560777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e0150664-2751-424e-864a-43eb2b72a4cf', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'e0150664-2751-424e-864a-43eb2b72a4cf', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:21:24.578730 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] Initialize volume connection completed successfully.
Oct 08 21:21:25.018850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-edde487d-24f6-4887-afdb-2fe3efaa5dac-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:25.034617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-edde487d-24f6-4887-afdb-2fe3efaa5dac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:25.037138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:25.563327 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=22,cinder:INSERT=12,cinder:DELETE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:25.604292 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['cdf72942-6419-4aec-b887-57b7aa363791', '4f5e48f8-0a8d-4562-b3f0-fc29c86163b4', '5ffd177d-643f-455d-9115-22233a7f8b13', '500785e5-3481-4db0-b33a-832b8748fa4f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:25.683779 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:21:25.689491 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2dc08f6a-e438-4dc5-a4bc-a3a179120f82 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-edde487d-24f6-4887-afdb-2fe3efaa5dac-delete_snapshot" released by "delete_snapshot" :: held 0.655s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:25.756334 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] Terminate volume connection completed successfully.
Oct 08 21:21:25.778321 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-dc26ca22-339f-4abc-9b14-f5ef49f1a7a2 tempest-VolumesBackupsV39Test-911242546 None] Remove volume export completed successfully.
Oct 08 21:21:26.314325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-933cba9a-f631-4d45-a147-99986beb05e4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:26.332163 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-933cba9a-f631-4d45-a147-99986beb05e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:26.428009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:26.637309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:26.637309 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-933cba9a-f631-4d45-a147-99986beb05e4 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:26.663539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-933cba9a-f631-4d45-a147-99986beb05e4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:28.349634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['08bb8ec8-873f-4635-a954-c8590379268b', '6cd293da-df9a-453b-9070-519aef172e7d', 'edbc5d62-fe29-4cf0-b486-0868be834e28', '7fb404dd-ee05-4c69-b116-ee585ce05c55'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:28.430715 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:28.523729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:28.596849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:28.625253 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:28.664726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-28b1e532-d5c3-4b50-9cb3-70b8645c5728 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-933cba9a-f631-4d45-a147-99986beb05e4-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:28.808254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-2e7b8d7b-3baa-4bf8-8bdb-e424e846360b-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:28.830733 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-2e7b8d7b-3baa-4bf8-8bdb-e424e846360b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:28.833342 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:29.815605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Acquiring lock "cinder-9451e2f2-f0e1-47c2-8884-972fd31d61cb-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:29.830147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Lock "cinder-9451e2f2-f0e1-47c2-8884-972fd31d61cb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:29.948314 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:31.261130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Volume volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:31.278636 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] deleting rbd volume volume-9451e2f2-f0e1-47c2-8884-972fd31d61cb {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:31.363478 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['201dd384-c49b-4a81-8c74-e6dc496a4be3', 'b46fb37e-b7d6-4db1-be93-6f8878f17c97', '6d795e30-8bff-4e52-af70-332c4d28ba9b', '77e2ef2f-1e64-416e-9859-96c2fad521d3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:31.436113 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:21:31.443623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6529f79a-3cad-4651-a493-a70987ba550f tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-2e7b8d7b-3baa-4bf8-8bdb-e424e846360b-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:31.498802 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] Terminate volume connection completed successfully.
Oct 08 21:21:31.529384 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e4434b19-2c61-4af3-b6e8-94922641e0bb tempest-VolumesBackupsTest-825618197 None] Remove volume export completed successfully.
Oct 08 21:21:31.546142 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:INSERT=8,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:31.578376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Created reservations ['7bfc6fd2-b77d-47f7-b178-69954f3ea8a1', '1ebf284d-3ba5-403c-9c7b-b0a6a9c361c2', 'a77c1cb2-69e5-4600-bac3-c52675028d4b', '286a1732-0c3e-4b07-b230-c5d3015e189b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:31.640653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:31.678213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:31.720069 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:31.725025 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Deleted volume successfully.
Oct 08 21:21:31.740171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ede3da0b-932a-495f-ae32-ea8872b66de2 tempest-VolumesBackupsV39Test-911242546 None] Lock "cinder-9451e2f2-f0e1-47c2-8884-972fd31d61cb-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:32.037857 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-6a80d8d0-8d40-4284-b7b0-342612a3b2b4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:32.049989 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-6a80d8d0-8d40-4284-b7b0-342612a3b2b4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:32.095227 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:32.141607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:32.142235 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:32.150306 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-6a80d8d0-8d40-4284-b7b0-342612a3b2b4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:32.403719 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['6a39531c-ff59-4a83-b9d2-d187a7de51ac', 'e95b2970-cba1-4f41-aa2c-cc9375ac4392', 'cf9a25c5-a9c6-454f-8f8d-8f025fde5bef', 'b939a4c1-3969-4993-80bb-93a9e7f26ad6'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:32.461529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:32.525027 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:32.574257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:32.578043 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:32.592977 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1d7bf849-51f6-4a5c-a75a-1331bf4ac6ad tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-6a80d8d0-8d40-4284-b7b0-342612a3b2b4-delete_volume" released by "delete_volume" :: held 0.543s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:33.096444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:33.121454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (bc06c0da-d5de-40e7-be28-bf6a43dc89d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:33.132831 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd23e15-b63b-4944-ab52-6eff23998cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.151636 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd23e15-b63b-4944-ab52-6eff23998cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:33Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_d179c255-9aee-4b06-a56b-308da55f99e1',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=76f2f2e5-e5ea-4293-a7c8-8b59296d1725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd238ac8ac5e4e7793c1ebb53a85eaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:33Z,use_quota=True,user_id='a009ac77727640de9becf6a61c8f1662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.158753 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce06e28-1a74-4502-8982-06b492e4bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.162991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce06e28-1a74-4502-8982-06b492e4bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.168406 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957af5cf-583e-4f6d-88e5-47986fef9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.172437 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957af5cf-583e-4f6d-88e5-47986fef9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'volume_name': 'volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.177215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce25c75a-35c0-46fa-ba41-e447c4597b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.181517 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce25c75a-35c0-46fa-ba41-e447c4597b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.187518 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2851f825-a68e-4d0c-9290-7d9fe5a67bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.189258 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Volume 76f2f2e5-e5ea-4293-a7c8-8b59296d1725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'volume_size': 1}
Oct 08 21:21:33.189823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] creating volume 'volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:33.191009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:33.239757 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=31,cinder:SELECT=55,cinder:INSERT=12,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:33.307018 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:33.307808 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:33.313328 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2851f825-a68e-4d0c-9290-7d9fe5a67bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.319568 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ca58dd-4165-4c6b-86d1-7c326afac530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:33.332064 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Volume volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725 (76f2f2e5-e5ea-4293-a7c8-8b59296d1725): created successfully
Oct 08 21:21:33.337172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ca58dd-4165-4c6b-86d1-7c326afac530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:33.345656 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Flow 'volume_create_manager' (bc06c0da-d5de-40e7-be28-bf6a43dc89d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:33.358461 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Created volume successfully.
Oct 08 21:21:33.410763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-345abd03-d885-42f6-826d-f0d74c528f9c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:33.431166 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-345abd03-d885-42f6-826d-f0d74c528f9c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:33.505322 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:33.586771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:33.598925 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-345abd03-d885-42f6-826d-f0d74c528f9c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:33.851243 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:33.899665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] deleting parent snapshot volume-345abd03-d885-42f6-826d-f0d74c528f9c.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:34.369778 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:21:34.433098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['b088623a-7c2d-467e-8bc5-294c50f124b8', '122d0f37-e0f6-4eb6-b2a5-c1c53f26f0f7', '20984f2e-1f8e-4b58-a2c3-3ed28624fbe3', '7b1b9216-e67a-479c-8d85-227235388b91'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:34.523123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:34.585930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:34.648147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:34.666897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-794709fa-e84e-498e-91fb-d7d9dc818bf7-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:34.670695 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:34.689643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-794709fa-e84e-498e-91fb-d7d9dc818bf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:34.691806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:34.787068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5497942-3bfe-443c-a016-482e641b7877 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-345abd03-d885-42f6-826d-f0d74c528f9c-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:35.482960 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.111s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:21:35.482960 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '76f2f2e5-e5ea-4293-a7c8-8b59296d1725', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:21:35.513779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:35.533781 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (be40ead3-0d3e-443f-b3dc-be4ed23f9626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:35.540078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71d860-f65f-4910-914b-0224148aadc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:35.570417 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71d860-f65f-4910-914b-0224148aadc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1373424888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ba17e69-b14e-48c8-8a97-9a1396b2da52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4772bcc4164e446598dade98933a9380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:35Z,use_quota=True,user_id='f4e770e68804425fa1955447b1b7bd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:35.576643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f92743-4596-4d05-98c3-8f8b01488169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:35.582345 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f92743-4596-4d05-98c3-8f8b01488169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:35.587186 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c9098a-ef0e-4d61-9e4c-055aab3abe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:35.606459 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Initialize volume connection completed successfully.
Oct 08 21:21:35.628908 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['c0389662-074c-4890-abfb-584f03817f1e', '3e8e9a19-f5ba-4a26-8d23-5e845e862321', 'e436254f-70ab-439c-8509-c1104eca6a06', '85af2424-cc05-4036-8d82-8338623cd0c9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:35.706202 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] Delete snapshot completed successfully.
Oct 08 21:21:35.719620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c9098a-ef0e-4d61-9e4c-055aab3abe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'volume_name': 'volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b058370>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:35.725238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f06ae29-1393-438b-baf4-9c638f206279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:35.728825 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f06ae29-1393-438b-baf4-9c638f206279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:35.733340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb35b2e-1101-4e91-9a1e-14c11262f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:35.734465 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Volume 3ba17e69-b14e-48c8-8a97-9a1396b2da52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b058370>}
Oct 08 21:21:35.735034 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Cloning 3ba17e69-b14e-48c8-8a97-9a1396b2da52 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:21:35.735796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:35.738646 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-57c898ba-8d5d-42df-bcc1-6d25a1975999 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-794709fa-e84e-498e-91fb-d7d9dc818bf7-delete_snapshot" released by "delete_snapshot" :: held 1.049s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:35.746375 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:35.757044 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 35, 750756)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:35.757517 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:35.757925 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:21:35.763283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:35.764192 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:21:35.776156 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Acquiring lock "cinder-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:35.781118 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 35, 768251)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:35.781692 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:35.782097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:21:35.803693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:35.813333 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:35.906577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] creating snapshot='volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:36.568638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52.clone_snap' to 'volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:36.655225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:36.795517 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:36.795916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Volume volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:36.802812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] deleting rbd volume volume-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:36.956431 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:36.964433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:36.964896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:37.052113 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:37.053103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Marking volume 3ba17e69-b14e-48c8-8a97-9a1396b2da52 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:21:37.081968 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 3ba17e69-b14e-48c8-8a97-9a1396b2da52. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:21:37.082478 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Creating volume glance metadata for volume 3ba17e69-b14e-48c8-8a97-9a1396b2da52 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:21:37.182640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb35b2e-1101-4e91-9a1e-14c11262f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b058370>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:37.197907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b230438a-4067-4a5b-a14d-1063617433a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:37.219201 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Volume volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52 (3ba17e69-b14e-48c8-8a97-9a1396b2da52): created successfully
Oct 08 21:21:37.224488 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b230438a-4067-4a5b-a14d-1063617433a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:37.233435 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (be40ead3-0d3e-443f-b3dc-be4ed23f9626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:37.241504 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=37,cinder:SELECT=54,cinder:INSERT=9 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:37.251733 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c5db3901-fedc-483c-a7ed-ec58ee5ecdbe tempest-VolumesCloneTest-2136811 None] Created volume successfully.
Oct 08 21:21:37.855933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Created reservations ['fad458c5-d611-4244-bc64-d23a6cbbca1b', '324d5e69-a040-4bea-b643-6d21875ee42c', '9eaef649-8d3e-4f69-acb0-1620d8e50cac', 'e7fa3045-0a02-497f-9771-8e2d87b93a5b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:37.941695 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=14 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:37.966321 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:38.099299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:38.209085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:38.231631 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Deleted volume successfully.
Oct 08 21:21:38.264769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9a379d9f-6098-4174-8d28-4c3818eb5962 tempest-VolumesSnapshotTestJSON-547814895 None] Lock "cinder-e6e294ba-6781-4b55-bc1c-d34d92ef1ea3-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:38.635727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:38.676188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (ebaa1f2d-15e0-4127-abfd-117c9e8262bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:38.684933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13003dd6-415e-432a-8787-9671b00adc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:38.703842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13003dd6-415e-432a-8787-9671b00adc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-746059635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4772bcc4164e446598dade98933a9380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=3ba17e69-b14e-48c8-8a97-9a1396b2da52,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:39Z,use_quota=True,user_id='f4e770e68804425fa1955447b1b7bd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:38.710568 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b81343a-ba20-47a4-bfaf-2e9980f6df0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:38.717929 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b81343a-ba20-47a4-bfaf-2e9980f6df0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:38.724521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04488dc8-3f65-4652-8b69-7931377dcc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:38.747113 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04488dc8-3f65-4652-8b69-7931377dcc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca', 'volume_name': 'volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca', 'volume_size': 1, 'source_volid': '3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:38.752738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99658bf-b26a-4974-a568-5926af7799d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:38.774259 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99658bf-b26a-4974-a568-5926af7799d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:38.785959 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e4e319-0cf8-4385-aedc-364353d72f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:38.788382 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Volume ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca', 'volume_size': 1, 'source_volid': '3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'source_volstatus': 'available'}
Oct 08 21:21:38.825984 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:38.980644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] creating snapshot='volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:39.563118 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] cloning 'volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52@volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca.clone_snap' to 'volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:39.823666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:39.825577 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:39.829696 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:39.856587 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:39.858097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Marking volume ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:21:39.870465 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Copying metadata from source volume 3ba17e69-b14e-48c8-8a97-9a1396b2da52 to ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}}
Oct 08 21:21:39.922964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e4e319-0cf8-4385-aedc-364353d72f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca', 'volume_size': 1, 'source_volid': '3ba17e69-b14e-48c8-8a97-9a1396b2da52', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:39.929325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e424e8d-d3b4-41b4-ac58-b4cc733e48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:39.949258 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Volume volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca (ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca): created successfully
Oct 08 21:21:39.955617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e424e8d-d3b4-41b4-ac58-b4cc733e48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:39.961504 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (ebaa1f2d-15e0-4127-abfd-117c9e8262bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:39.979442 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-16086ec2-9807-4a0c-b179-5fb6d0a31397 tempest-VolumesCloneTest-2136811 None] Created volume successfully.
Oct 08 21:21:41.062918 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Terminate volume connection completed successfully.
Oct 08 21:21:41.088371 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5b72372c-0f40-483e-85fa-d22c8c309e51 tempest-VolumesBackupsTest-825618197 None] Remove volume export completed successfully.
Oct 08 21:21:41.163113 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:41.188055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (75479ff8-200e-42b2-afa2-14ee7b3d6481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:41.197623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b8ce4-607d-44c1-b388-ab589ebd9bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.217350 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b8ce4-607d-44c1-b388-ab589ebd9bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-35162503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ecbbf88-37bc-41c0-a23f-259f82533736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4772bcc4164e446598dade98933a9380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:41Z,use_quota=True,user_id='f4e770e68804425fa1955447b1b7bd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.222927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7efc76-3f5b-42c1-beac-07db069ddf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.227065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7efc76-3f5b-42c1-beac-07db069ddf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.232587 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510a995a-fd80-457e-ae46-d980fdad202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.236601 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510a995a-fd80-457e-ae46-d980fdad202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecbbf88-37bc-41c0-a23f-259f82533736', 'volume_name': 'volume-2ecbbf88-37bc-41c0-a23f-259f82533736', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.241682 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6428a4-5a14-4789-b760-eca6e35c1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.245727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6428a4-5a14-4789-b760-eca6e35c1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.250320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c20899-ee72-4aa7-bf37-431e99905077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.251414 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Volume 2ecbbf88-37bc-41c0-a23f-259f82533736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecbbf88-37bc-41c0-a23f-259f82533736', 'volume_size': 1}
Oct 08 21:21:41.251796 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] creating volume 'volume-2ecbbf88-37bc-41c0-a23f-259f82533736' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:41.252573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:41.318714 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:41.319397 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:41.323993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c20899-ee72-4aa7-bf37-431e99905077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecbbf88-37bc-41c0-a23f-259f82533736', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.328642 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e606e2f9-2bd5-4e1b-ad41-102d2c667850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:41.340541 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Volume volume-2ecbbf88-37bc-41c0-a23f-259f82533736 (2ecbbf88-37bc-41c0-a23f-259f82533736): created successfully
Oct 08 21:21:41.344519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e606e2f9-2bd5-4e1b-ad41-102d2c667850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:41.350147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (75479ff8-200e-42b2-afa2-14ee7b3d6481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:41.364738 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-90b963ef-3349-430a-8f31-0d629fe2866f tempest-VolumesCloneTest-2136811 None] Created volume successfully.
Oct 08 21:21:41.631346 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Acquiring lock "cinder-76f2f2e5-e5ea-4293-a7c8-8b59296d1725-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:41.642440 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-76f2f2e5-e5ea-4293-a7c8-8b59296d1725-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:41.738101 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:42.161439 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Volume volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:42.174332 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] deleting rbd volume volume-76f2f2e5-e5ea-4293-a7c8-8b59296d1725 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:42.191250 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:42.212140 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Flow 'volume_create_manager' (467ac3b6-0824-40c8-943f-45e29458be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:42.219695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbc9345-7873-417f-83ca-73760b2dd5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.238462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbc9345-7873-417f-83ca-73760b2dd5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1319533292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5ce96d74-3031-4205-ba6e-75e4638ab6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc40a09d4b147f6a41eacfd10097b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:42Z,use_quota=True,user_id='868a6ce0f1f04f809bd0b432facc5534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.243960 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1739605e-e3e4-426c-ae26-64f42af9acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.249400 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1739605e-e3e4-426c-ae26-64f42af9acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.254709 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77090e2-7efb-4528-94a9-44bbfc79fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.259459 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77090e2-7efb-4528-94a9-44bbfc79fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce96d74-3031-4205-ba6e-75e4638ab6d0', 'volume_name': 'volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.265118 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3c42a5-3f12-4ce2-b14b-11c8a621368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.269715 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3c42a5-3f12-4ce2-b14b-11c8a621368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.275722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199167f-7ddc-4fcd-8f00-8083c704702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.277080 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Volume 5ce96d74-3031-4205-ba6e-75e4638ab6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0', 'volume_size': 1}
Oct 08 21:21:42.277669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] creating volume 'volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:42.278564 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:42.350517 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:42.351003 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:42.355880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1199167f-7ddc-4fcd-8f00-8083c704702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.362427 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c7029-2a92-45f6-9d1b-91d48399957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.381136 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Volume volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0 (5ce96d74-3031-4205-ba6e-75e4638ab6d0): created successfully
Oct 08 21:21:42.388497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c7029-2a92-45f6-9d1b-91d48399957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.394083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Flow 'volume_create_manager' (467ac3b6-0824-40c8-943f-45e29458be66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:42.406039 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3e523454-0e6c-4bf2-ade8-aad64bc208f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Created volume successfully.
Oct 08 21:21:42.779799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:42.802377 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Created reservations ['91f77767-ef88-488f-a012-80428a1094d1', '34c451ae-463a-4030-be05-39cdc2e4d979', 'e9110d40-70df-454c-b2ff-7e620af70683', 'b4f8a399-05b9-4964-acf8-e2c3e5763f93'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:42.834110 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (2aaaf640-da29-4b5d-8720-850f4dfe907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:42.841635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755f06ed-16a3-46af-a77b-73f9f7e5f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.863142 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755f06ed-16a3-46af-a77b-73f9f7e5f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2082507213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d9c4ce4-54cd-49a9-ad52-d498803e5fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4772bcc4164e446598dade98933a9380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2ecbbf88-37bc-41c0-a23f-259f82533736,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:43Z,use_quota=True,user_id='f4e770e68804425fa1955447b1b7bd71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.869726 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98312c2a-6ced-479b-9e56-57a40bd3992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.875457 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98312c2a-6ced-479b-9e56-57a40bd3992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.881924 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799cc83b-144e-41da-88a8-73de8cfca62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.904188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799cc83b-144e-41da-88a8-73de8cfca62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d9c4ce4-54cd-49a9-ad52-d498803e5fc6', 'volume_name': 'volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6', 'volume_size': 2, 'source_volid': '2ecbbf88-37bc-41c0-a23f-259f82533736', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.910799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0d54b-47cb-411a-9ab0-10c8657a7452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.916139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0d54b-47cb-411a-9ab0-10c8657a7452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:42.923804 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd70a07-e2f2-44ef-b5b7-1284618b93e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:42.925413 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Volume 6d9c4ce4-54cd-49a9-ad52-d498803e5fc6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6', 'volume_size': 2, 'source_volid': '2ecbbf88-37bc-41c0-a23f-259f82533736', 'source_volstatus': 'available'}
Oct 08 21:21:42.952534 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:43.030702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] creating snapshot='volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:43.176647 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] cloning 'volume-2ecbbf88-37bc-41c0-a23f-259f82533736@volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6.clone_snap' to 'volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:43.212779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:43.318046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Volume volume-2ecbbf88-37bc-41c0-a23f-259f82533736 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:43.319421 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:43.319914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:43.334225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] resize volume 'volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6' from 1 to 2 {{(pid=133344) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:812}}
Oct 08 21:21:43.334882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:43.397207 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:43.446631 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:43.454792 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Deleted volume successfully.
Oct 08 21:21:43.461388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1912e1db-b9e0-4c6d-831f-71749a59cc9e tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:43.536393 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:43.540028 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd70a07-e2f2-44ef-b5b7-1284618b93e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6', 'volume_size': 2, 'source_volid': '2ecbbf88-37bc-41c0-a23f-259f82533736', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:43.544912 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873f3a6a-7307-4b48-af81-94ee53e5c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:43.558153 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Volume volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6 (6d9c4ce4-54cd-49a9-ad52-d498803e5fc6): created successfully
Oct 08 21:21:43.561674 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873f3a6a-7307-4b48-af81-94ee53e5c50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:43.566895 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Flow 'volume_create_manager' (2aaaf640-da29-4b5d-8720-850f4dfe907b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:43.590354 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-51b54824-3be5-4e78-9d6c-e355959a4ef3 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-76f2f2e5-e5ea-4293-a7c8-8b59296d1725-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:43.596773 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5345df82-115d-4085-823e-a84910b1692a tempest-VolumesCloneTest-2136811 None] Created volume successfully.
Oct 08 21:21:43.853444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Acquiring lock "cinder-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:43.866241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Lock "cinder-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:43.936900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:44.001575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:44.012252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] deleting rbd volume volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:44.263879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:44.283441 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Volume volume-2ecbbf88-37bc-41c0-a23f-259f82533736 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:44.284581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] deleting parent snapshot volume-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:45.229462 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Acquiring lock "cinder-e0150664-2751-424e-864a-43eb2b72a4cf-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:45.249960 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1912e1db-b9e0-4c6d-831f-71749a59cc9e tempest-VolumesSnapshotListTestJSON-476139911 None] Create snapshot completed successfully
Oct 08 21:21:45.255743 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-e0150664-2751-424e-864a-43eb2b72a4cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:45.281138 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:45.312471 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Created reservations ['9d5db89a-a23f-4d4f-9c0b-7cdff3e5a8f5', 'dcef3eb2-f538-40c8-9eed-82f7c4160baa', '1a417226-f91f-42ae-8d44-085339f6d1c2', 'e765da57-1f29-43ef-886b-9dc79b5ef422'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:45.318873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:46.260676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] deleting rbd volume volume-e0150664-2751-424e-864a-43eb2b72a4cf {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:46.356395 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=58,cinder:UPDATE=27,cinder:INSERT=15 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:46.372771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:46.434040 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:46.503763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:46.517324 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Deleted volume successfully.
Oct 08 21:21:46.546730 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f49489db-f778-479c-80a1-70a4bd53e577 tempest-VolumesCloneTest-2136811 None] Lock "cinder-6d9c4ce4-54cd-49a9-ad52-d498803e5fc6-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:46.561621 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1da81aed-0783-4268-9a63-f9cbe0398cd6 tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:46.614286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:46.649761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] deleting parent snapshot volume-e0150664-2751-424e-864a-43eb2b72a4cf.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:47.263981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Acquiring lock "cinder-2ecbbf88-37bc-41c0-a23f-259f82533736-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:47.284231 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Lock "cinder-2ecbbf88-37bc-41c0-a23f-259f82533736-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:47.370946 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1da81aed-0783-4268-9a63-f9cbe0398cd6 tempest-VolumesSnapshotListTestJSON-476139911 None] Create snapshot completed successfully
Oct 08 21:21:47.376512 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.425771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:47.426308 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Volume volume-2ecbbf88-37bc-41c0-a23f-259f82533736 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:47.430902 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] deleting rbd volume volume-2ecbbf88-37bc-41c0-a23f-259f82533736 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:47.433670 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Created reservations ['bcce07a1-e21e-4cd1-bb9d-88c8340e0f55', 'a688adde-8152-4ff4-a705-b9958753a33f', 'e46af645-227d-4827-bd80-088ba2cd869b', '7ecf4a4d-95bb-4d5a-ad3e-6211a1a92ed9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:47.491324 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.526470 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.583322 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:47.595267 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Deleted volume successfully.
Oct 08 21:21:47.622139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bb6d860-cfbf-46ba-a044-8baf44372320 tempest-VolumesBackupsTest-825618197 None] Lock "cinder-e0150664-2751-424e-864a-43eb2b72a4cf-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:47.710054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Created reservations ['ca6de15d-8ed9-4f38-8f1a-b690d21d5937', '013544cc-fc20-4bcf-a93f-735e7c36aac5', '7b42c38a-1c7f-494d-b018-30a1604a2bfa', 'a006fc72-ecbe-4d5f-9f33-954b867c33ab'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:47.800673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.839435 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.870392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:47.874464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2714d4e3-65d8-4026-951a-bd2d928f39bb tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:47.920565 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Deleted volume successfully.
Oct 08 21:21:47.936238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-33694cd4-0138-44fa-8d28-f3e81bdce04f tempest-VolumesCloneTest-2136811 None] Lock "cinder-2ecbbf88-37bc-41c0-a23f-259f82533736-delete_volume" released by "delete_volume" :: held 0.652s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:48.298955 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Acquiring lock "cinder-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:48.335904 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Lock "cinder-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:48.342296 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2714d4e3-65d8-4026-951a-bd2d928f39bb tempest-VolumesSnapshotListTestJSON-476139911 None] Create snapshot completed successfully
Oct 08 21:21:48.384582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:48.502431 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:48.512599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] deleting rbd volume volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:48.737850 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:48.794935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] deleting parent snapshot volume-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:49.367965 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Created reservations ['71886630-b154-48f8-9033-f75237014c63', '142bf66c-2c15-4a5f-872e-81a9b4587184', '06fb0fc7-c618-4d73-a32b-155b8be54e13', '29e45595-ec67-49c6-a02b-752e71d036d3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:49.450881 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:49.564651 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Acquiring lock "cinder-3ba17e69-b14e-48c8-8a97-9a1396b2da52-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:49.567767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:49.649864 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:49.661249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Lock "cinder-3ba17e69-b14e-48c8-8a97-9a1396b2da52-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:49.667402 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Deleted volume successfully.
Oct 08 21:21:49.706341 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c85af93e-7b5f-4627-bb04-4d8642349a03 tempest-VolumesCloneTest-2136811 None] Lock "cinder-ae06ac1d-6590-4e74-a8e2-dbf8e177f6ca-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:49.717981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:49.817592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:49.829486 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] deleting rbd volume volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:49.840917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] Acquiring lock "cinder-8fe1e260-8f3a-4fe6-8a2d-6d18af8a8bcf-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:49.878222 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-8fe1e260-8f3a-4fe6-8a2d-6d18af8a8bcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:49.880286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:50.097594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:21:50.152854 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] deleting parent snapshot volume-3ba17e69-b14e-48c8-8a97-9a1396b2da52.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:21:50.443289 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Created reservations ['bf26c458-33e8-4417-aaa0-99a6cf35e373', 'a711b416-db1f-452e-ae4f-4946f0afa62b', '21ba8973-3bf3-43a0-906e-a18f7d0ea4bc', 'cba6b55e-b2ee-4916-a6ca-a190f056c50b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:50.464469 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:DELETE=3,cinder:UPDATE=31,cinder:INSERT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:50.472289 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=35,cinder:SELECT=53,cinder:INSERT=9,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:50.530058 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:50.615772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:50.694489 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:50.699692 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Deleted volume successfully.
Oct 08 21:21:50.715075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] Created reservations ['3fcc6f94-8c0d-491c-aeb6-0807890dc41e', '84b7e64e-7665-4b23-934c-721bab911ca1', 'a6cfdaac-dfeb-441e-9fdb-ee7af4d53725', 'c134c275-e339-4a07-a97c-6a08d682239c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:50.731803 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8848df46-3d1d-4d94-9a53-9d84d3a2dc56 tempest-VolumesCloneTest-2136811 None] Lock "cinder-3ba17e69-b14e-48c8-8a97-9a1396b2da52-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:50.797329 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] Delete snapshot completed successfully.
Oct 08 21:21:50.805708 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8f12539b-d267-431c-adba-3aa4ad10be88 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-8fe1e260-8f3a-4fe6-8a2d-6d18af8a8bcf-delete_snapshot" released by "delete_snapshot" :: held 0.928s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:51.057010 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Acquiring lock "cinder-6ddaef57-5aff-45de-ac68-468939e89c03-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:51.084436 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-6ddaef57-5aff-45de-ac68-468939e89c03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:51.086637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:51.528870 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Created reservations ['6d2b945c-96ed-4298-855b-e4467969368e', 'bb2efb5f-e762-4d60-9d7f-1e1bf04d22dc', '1e4ebcc2-9a3d-449c-9e09-c083e0b137a8', '20e2d2ec-9ed5-4e8c-a365-11c03123c37c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:51.590742 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Delete snapshot completed successfully.
Oct 08 21:21:51.599985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3a6e85fe-3728-4c6d-9ea8-f72287bca4f5 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-6ddaef57-5aff-45de-ac68-468939e89c03-delete_snapshot" released by "delete_snapshot" :: held 0.519s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:52.346082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] Acquiring lock "cinder-38465b23-ade4-48e4-b028-f5bea2e9a7a5-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:52.363744 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-38465b23-ade4-48e4-b028-f5bea2e9a7a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:52.369926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:53.544414 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] Created reservations ['574b19cf-31f0-4174-a4e6-8cff589b93e4', 'b4508f6d-ef74-4f79-8bce-02cedf2d9d0a', '2d5b95cf-dfdf-453f-8a36-eb5d2412af19', '06b367ac-324b-4751-be28-25a919934016'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:53.658580 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] Delete snapshot completed successfully.
Oct 08 21:21:53.671775 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3e396287-635a-4afd-8a36-89bb99915bc5 tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-38465b23-ade4-48e4-b028-f5bea2e9a7a5-delete_snapshot" released by "delete_snapshot" :: held 1.308s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:54.640641 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Acquiring lock "cinder-5ce96d74-3031-4205-ba6e-75e4638ab6d0-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:54.660004 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-5ce96d74-3031-4205-ba6e-75e4638ab6d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:54.733578 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:54.754194 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Flow 'volume_create_manager' (54073c72-d09a-4e96-b872-327563fdd1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:54.760806 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed4f6de-265f-4431-8953-853274b69f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:54.780581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed4f6de-265f-4431-8953-853274b69f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-338035657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6a19d9f-dfeb-4421-aa05-97ae812a6b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f95ca7a58d453388cf41258f9898b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:55Z,use_quota=True,user_id='87124fa1e1994feaa7d65efadf1feb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:54.787027 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e596d28-d8dc-44f7-abca-c2b8e58681c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:54.791755 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e596d28-d8dc-44f7-abca-c2b8e58681c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:54.797135 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b26c9-857a-4cc5-9e81-e6ae09cd0dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:54.807890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:54.887268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:21:54.887673 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Volume volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:54.902730 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] deleting rbd volume volume-5ce96d74-3031-4205-ba6e-75e4638ab6d0 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:21:55.059386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b26c9-857a-4cc5-9e81-e6ae09cd0dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6a19d9f-dfeb-4421-aa05-97ae812a6b06', 'volume_name': 'volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b1404c0>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:55.072105 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70b1ff-4f4b-49a4-92b7-3e910351c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:55.084174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70b1ff-4f4b-49a4-92b7-3e910351c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:55.093873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47654d39-3e24-4a71-aeee-c9e7a55fc78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:55.097542 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Volume a6a19d9f-dfeb-4421-aa05-97ae812a6b06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b1404c0>}
Oct 08 21:21:55.098098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Cloning a6a19d9f-dfeb-4421-aa05-97ae812a6b06 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:21:55.100394 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:21:55.123239 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:21:55.147179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 55, 132418)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:55.147702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:55.148225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:21:55.155684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:55.156770 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:21:55.172846 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 21, 55, 165017)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:21:55.173312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:21:55.176305 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:21:55.208607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:55.323950 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] creating snapshot='volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:21:55.468610 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06.clone_snap' to 'volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:21:55.578297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Created reservations ['f715d1b3-787b-45ad-8e84-8fbbc6586a8b', '025d1b62-afda-4a1e-bc8e-ea77ad347280', 'b2f318e8-df1e-4342-a716-7180e2c701ab', '19544895-3809-4959-9cfe-a1f2904ff68d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:21:55.632354 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=35,cinder:SELECT=54,cinder:INSERT=10,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:55.682725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:21:55.686977 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:55.687666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:55.734942 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:21:55.735800 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Marking volume a6a19d9f-dfeb-4421-aa05-97ae812a6b06 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:21:55.756407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:55.834222 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to a6a19d9f-dfeb-4421-aa05-97ae812a6b06. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:21:55.834539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Creating volume glance metadata for volume a6a19d9f-dfeb-4421-aa05-97ae812a6b06 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:21:55.838428 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:55.925095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:21:55.935623 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Deleted volume successfully.
Oct 08 21:21:55.975973 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1c961570-5857-420c-963b-431c64441cbc tempest-VolumesSnapshotListTestJSON-476139911 None] Lock "cinder-5ce96d74-3031-4205-ba6e-75e4638ab6d0-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:21:56.044418 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47654d39-3e24-4a71-aeee-c9e7a55fc78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b1404c0>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:56.055489 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6219d154-6496-4186-8adc-5f9886b6e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:56.082124 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Volume volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06 (a6a19d9f-dfeb-4421-aa05-97ae812a6b06): created successfully
Oct 08 21:21:56.085267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6219d154-6496-4186-8adc-5f9886b6e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:56.100460 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Flow 'volume_create_manager' (54073c72-d09a-4e96-b872-327563fdd1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:56.136334 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b405c00e-2c99-482b-9b50-7ae2413cb0fe tempest-VolumesExtendTest-755733357 None] Created volume successfully.
Oct 08 21:21:57.125975 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fa8c1043-772d-422f-9568-98eaabadcf66 tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:57.320873 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fa8c1043-772d-422f-9568-98eaabadcf66 tempest-VolumesExtendTest-755733357 None] Extend volume from 1 GB to 2 GB. {{(pid=133344) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}}
Oct 08 21:21:57.380583 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fa8c1043-772d-422f-9568-98eaabadcf66 tempest-VolumesExtendTest-755733357 None] Extend volume completed successfully.
Oct 08 21:21:59.165404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:21:59.211483 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Flow 'volume_create_manager' (eba4fce2-f6c9-4284-9c56-35695572958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:59.237126 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395d3b3-fc96-47b1-a052-457c7c3457dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.289540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395d3b3-fc96-47b1-a052-457c7c3457dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-993281638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=57e5a1f6-8bdd-4de8-a076-cc8e8663025c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f95ca7a58d453388cf41258f9898b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:21:59Z,use_quota=True,user_id='87124fa1e1994feaa7d65efadf1feb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.304551 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57c086d-1e85-41e5-b997-4cd7555e87e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.312285 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57c086d-1e85-41e5-b997-4cd7555e87e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.351291 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c199b6-76d6-4f90-9aaa-afeacb41abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.372340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c199b6-76d6-4f90-9aaa-afeacb41abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e5a1f6-8bdd-4de8-a076-cc8e8663025c', 'volume_name': 'volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.379424 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a137296a-da12-45c3-8a8c-aa45beffae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.393732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a137296a-da12-45c3-8a8c-aa45beffae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.409407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8809d03-0915-4d79-9909-4c9459534338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.410903 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Volume 57e5a1f6-8bdd-4de8-a076-cc8e8663025c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c', 'volume_size': 1}
Oct 08 21:21:59.414553 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] creating volume 'volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:21:59.417513 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:21:59.556545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:21:59.556983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:21:59.561404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8809d03-0915-4d79-9909-4c9459534338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.571473 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c8b4f7-9e2e-463a-b134-de1af9ecc36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:21:59.583916 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=33,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:21:59.593153 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Volume volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c (57e5a1f6-8bdd-4de8-a076-cc8e8663025c): created successfully
Oct 08 21:21:59.598725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c8b4f7-9e2e-463a-b134-de1af9ecc36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:21:59.622460 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Flow 'volume_create_manager' (eba4fce2-f6c9-4284-9c56-35695572958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:21:59.636698 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-271c823b-9667-4ebb-9fed-ff1d1b51c292 tempest-VolumesExtendTest-755733357 None] Created volume successfully.
Oct 08 21:22:00.443994 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5113151b-419c-413a-8420-f7038477e96c tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:01.378861 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5113151b-419c-413a-8420-f7038477e96c tempest-VolumesExtendTest-755733357 None] Create snapshot completed successfully
Oct 08 21:22:01.748404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ada83b71-3cf7-4d96-a747-501ec893aa7f tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:01.937769 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ada83b71-3cf7-4d96-a747-501ec893aa7f tempest-VolumesExtendTest-755733357 None] Extend volume from 1 GB to 2 GB. {{(pid=133344) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}}
Oct 08 21:22:01.995381 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ada83b71-3cf7-4d96-a747-501ec893aa7f tempest-VolumesExtendTest-755733357 None] Extend volume completed successfully.
Oct 08 21:22:03.110880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] Acquiring lock "cinder-9807fcaf-6d19-4382-adaa-e9bc1832970f-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:03.134573 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] Lock "cinder-9807fcaf-6d19-4382-adaa-e9bc1832970f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:03.138482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:04.386907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] Created reservations ['801f1351-9948-46b8-8e06-228e64a7f21b', 'f092afb6-ebfa-4fce-9fe3-b000c8ad63d6', 'fbeda9bb-8351-45d5-abfc-e8ba5b3c4dd4', '76cec19d-0280-422c-9dce-9826defa6a7d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:04.441331 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] Delete snapshot completed successfully.
Oct 08 21:22:04.457085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-eec74716-b8ba-47a4-9a3d-92aac93d015a tempest-VolumesExtendTest-755733357 None] Lock "cinder-9807fcaf-6d19-4382-adaa-e9bc1832970f-delete_snapshot" released by "delete_snapshot" :: held 1.325s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:05.368054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Acquiring lock "cinder-57e5a1f6-8bdd-4de8-a076-cc8e8663025c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:05.380761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Lock "cinder-57e5a1f6-8bdd-4de8-a076-cc8e8663025c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:05.454838 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:05.534762 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:05.535402 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Volume volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:05.545085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] deleting rbd volume volume-57e5a1f6-8bdd-4de8-a076-cc8e8663025c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:05.896257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Created reservations ['30876cd1-b96d-40e7-a067-f1f58f0615c8', 'a95db114-2d6e-4219-96fd-54aae7f09055', '159659b9-4499-41e1-b603-641fddb070f5', 'e45868e6-9d3e-4abe-a4e2-be285ad7adec'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:05.960479 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:22:05.962777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:06.082109 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:06.165571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:06.185692 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:06.241208 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:06.318399 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:06.323833 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Deleted volume successfully.
Oct 08 21:22:06.351550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6e840771-3e92-4709-a965-c0bf6f9f816f tempest-VolumesExtendTest-755733357 None] Lock "cinder-57e5a1f6-8bdd-4de8-a076-cc8e8663025c-delete_volume" released by "delete_volume" :: held 0.971s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:06.621537 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Acquiring lock "cinder-a6a19d9f-dfeb-4421-aa05-97ae812a6b06-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:06.637491 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Lock "cinder-a6a19d9f-dfeb-4421-aa05-97ae812a6b06-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:06.707844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:06.812768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:06.825948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] deleting rbd volume volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:07.190955 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:22:07.226550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] deleting parent snapshot volume-a6a19d9f-dfeb-4421-aa05-97ae812a6b06.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:22:08.340403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Created reservations ['6eaa5d80-860b-450d-858e-6210a9bf0fa4', '875acb66-fd6c-4e5b-a980-628e6254e41e', '3261a735-3faa-4335-8088-3a5380a1c0f5', 'e871b0dd-ce77-4ffe-ab42-a1349445cc10'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:08.437177 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:08.528104 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:08.604099 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:08.617231 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Deleted volume successfully.
Oct 08 21:22:08.643818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-2fdc9fa1-7e02-4235-9bce-2d46d738bd6b tempest-VolumesExtendTest-755733357 None] Lock "cinder-a6a19d9f-dfeb-4421-aa05-97ae812a6b06-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:13.950957 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=52,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:13.982136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:14.019880 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (9ba485ec-d9e0-4650-b588-3615e1c5cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:14.027148 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074ef24d-aff8-4d12-a16c-d3056d0a3cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.047682 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074ef24d-aff8-4d12-a16c-d3056d0a3cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1409740194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc983965-1ccd-4c44-a12f-872c92cdcc97,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:14Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.061757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4a5742-58c5-488e-85ee-6407f2dfbb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.074211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4a5742-58c5-488e-85ee-6407f2dfbb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.088326 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3d246f-fa40-407d-8c41-ead81e373296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.100550 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3d246f-fa40-407d-8c41-ead81e373296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc983965-1ccd-4c44-a12f-872c92cdcc97', 'volume_name': 'volume-fc983965-1ccd-4c44-a12f-872c92cdcc97', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.110171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf37145-28db-4791-a987-99e4a3452cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.117474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf37145-28db-4791-a987-99e4a3452cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.130635 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc5ee15-5deb-448c-a951-2618f57244b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.131764 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Volume fc983965-1ccd-4c44-a12f-872c92cdcc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc983965-1ccd-4c44-a12f-872c92cdcc97', 'volume_size': 1}
Oct 08 21:22:14.132136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] creating volume 'volume-fc983965-1ccd-4c44-a12f-872c92cdcc97' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:22:14.133083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:14.304793 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:14.305528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:14.313878 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc5ee15-5deb-448c-a951-2618f57244b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc983965-1ccd-4c44-a12f-872c92cdcc97', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.325766 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a31b57-5c8f-40c6-9d7d-484dfc866d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:14.341015 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Volume volume-fc983965-1ccd-4c44-a12f-872c92cdcc97 (fc983965-1ccd-4c44-a12f-872c92cdcc97): created successfully
Oct 08 21:22:14.349421 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a31b57-5c8f-40c6-9d7d-484dfc866d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:14.357799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (9ba485ec-d9e0-4650-b588-3615e1c5cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:14.404641 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-64ee9e17-2851-426e-8c7f-3c6721452c08 tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:16.621239 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:16.685264 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (8e6d5dc5-7e7c-42d7-8279-7db33f7e18c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:16.694480 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a639849-9b20-49cf-a8b1-026a47e82c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.732596 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a639849-9b20-49cf-a8b1-026a47e82c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1546854549',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=245808e4-45c6-4ef9-a99c-7fa9e136ad53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:17Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.741396 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c45239-b5c5-48c3-b693-da6903e911ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.749457 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c45239-b5c5-48c3-b693-da6903e911ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.761818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f660495-3038-4721-a47f-6cfc66262292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.766025 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f660495-3038-4721-a47f-6cfc66262292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245808e4-45c6-4ef9-a99c-7fa9e136ad53', 'volume_name': 'volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.770981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd1bc3f-95d5-4d61-8d51-9f288ea332f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.778741 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd1bc3f-95d5-4d61-8d51-9f288ea332f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.784143 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903c0c1c-6a77-4630-bd52-b033acff5702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.787953 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Volume 245808e4-45c6-4ef9-a99c-7fa9e136ad53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53', 'volume_size': 1}
Oct 08 21:22:16.789022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] creating volume 'volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:22:16.790670 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:16.904952 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:16.905358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:16.908923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903c0c1c-6a77-4630-bd52-b033acff5702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.913882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c0b8b9-4fa5-40ea-b697-befae23631c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:16.939522 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Volume volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53 (245808e4-45c6-4ef9-a99c-7fa9e136ad53): created successfully
Oct 08 21:22:16.943416 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c0b8b9-4fa5-40ea-b697-befae23631c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:16.953275 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (8e6d5dc5-7e7c-42d7-8279-7db33f7e18c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:16.970387 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b546c3cd-e842-4aaf-8c7f-59dda7b2b45e tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:17.853728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-245808e4-45c6-4ef9-a99c-7fa9e136ad53-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:17.875490 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Lock "cinder-245808e4-45c6-4ef9-a99c-7fa9e136ad53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:17.931391 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:17.947194 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:18.016184 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:18.016614 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Volume volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:18.021763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-245808e4-45c6-4ef9-a99c-7fa9e136ad53 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:18.339279 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Created reservations ['58e3e5ed-3e27-41bf-9904-59c8fd6b17b2', '007de0bd-0ce0-42b7-bf40-4668ab62731d', '45b619a9-3e75-4cc0-b049-122f51f46159', 'dc648837-58e0-4217-9d11-fcaf4fb5ed7f'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:18.435062 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:18.538253 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:18.627666 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:18.644861 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:18.676500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-fbef7893-96bd-438f-8f66-14c92e2fc7cd tempest-VolumesGetTest-1286211129 None] Lock "cinder-245808e4-45c6-4ef9-a99c-7fa9e136ad53-delete_volume" released by "delete_volume" :: held 0.801s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:19.082962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-fc983965-1ccd-4c44-a12f-872c92cdcc97-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:19.118957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Lock "cinder-fc983965-1ccd-4c44-a12f-872c92cdcc97-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:19.246340 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:19.335263 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:19.335581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Volume volume-fc983965-1ccd-4c44-a12f-872c92cdcc97 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:19.344835 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-fc983965-1ccd-4c44-a12f-872c92cdcc97 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:19.776497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Created reservations ['6c7f2e02-190e-4372-afd6-0f86ff76206c', '8de65471-92cd-4b67-9179-8cbb8507029b', '9c280e59-43d7-4d5d-ac6e-94265722b149', 'f4b826f1-f21d-47ff-a117-08566cc713fa'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:19.878206 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:19.936951 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:19.984497 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:19.988736 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:20.023729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-77e2c07f-7ac7-463e-8588-9926b2130c5d tempest-VolumesGetTest-1286211129 None] Lock "cinder-fc983965-1ccd-4c44-a12f-872c92cdcc97-delete_volume" released by "delete_volume" :: held 0.906s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:21.017625 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:21.040549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (1d77f048-dc29-4022-bea6-b23f2a0a73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:21.046998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc973764-c60c-473d-bf7e-27800d14befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.064534 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc973764-c60c-473d-bf7e-27800d14befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-916896963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7dc2fa17-1de9-4ed5-9ede-edf116c2686c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:21Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.070336 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25be43bf-0e05-4d55-b5db-c283804e85f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.076606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25be43bf-0e05-4d55-b5db-c283804e85f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.082147 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf5017b-0476-4376-bb2d-c18f56709365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.087668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf5017b-0476-4376-bb2d-c18f56709365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'volume_name': 'volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.092638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d1b1c-809b-4ee6-a526-37a76f16f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.097004 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d1b1c-809b-4ee6-a526-37a76f16f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.103246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566fe04-8c88-4772-812e-92b0ad6d63de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.104617 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Volume 7dc2fa17-1de9-4ed5-9ede-edf116c2686c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'volume_size': 1}
Oct 08 21:22:21.105013 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] creating volume 'volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:22:21.106842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:21.187510 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:21.188152 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:21.193111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566fe04-8c88-4772-812e-92b0ad6d63de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.198773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbfc7fe-bd2f-4efa-ba63-b2726c0b6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:21.208542 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Volume volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c (7dc2fa17-1de9-4ed5-9ede-edf116c2686c): created successfully
Oct 08 21:22:21.213823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbfc7fe-bd2f-4efa-ba63-b2726c0b6633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:21.219913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (1d77f048-dc29-4022-bea6-b23f2a0a73fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:21.230150 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8ad861c8-b982-4586-976a-ad320d7799cd tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:22.551913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:22.591738 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (d2b624a1-cdad-418b-bedf-533285379c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:22.600779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2721743b-0708-4354-85cd-206b5df67d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:22.647860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2721743b-0708-4354-85cd-206b5df67d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1278319049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6c9c3ed-8cc5-42e3-b262-16b86647f94f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=7dc2fa17-1de9-4ed5-9ede-edf116c2686c,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:22Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:22.665969 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52040066-d948-4e2c-a86e-6f3fcd6103d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:22.672086 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52040066-d948-4e2c-a86e-6f3fcd6103d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:22.693447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b490439d-be3f-4e29-8fb8-b0a0ff431406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:22.732716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b490439d-be3f-4e29-8fb8-b0a0ff431406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f6c9c3ed-8cc5-42e3-b262-16b86647f94f', 'volume_name': 'volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f', 'volume_size': 1, 'source_volid': '7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:22.752221 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f35952-bfa5-46e7-b80b-b27276826c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:22.759335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f35952-bfa5-46e7-b80b-b27276826c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:22.766310 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a9933-b46d-40e4-9642-9060748aa328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:22.768420 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Volume f6c9c3ed-8cc5-42e3-b262-16b86647f94f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f', 'volume_size': 1, 'source_volid': '7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'source_volstatus': 'available'}
Oct 08 21:22:22.783120 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:22.841820 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] creating snapshot='volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:22:23.313289 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] cloning 'volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c@volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f.clone_snap' to 'volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:22:23.508046 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Volume volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:23.512575 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:23.513362 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:23.545075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:22:23.550955 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a9933-b46d-40e4-9642-9060748aa328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f', 'volume_size': 1, 'source_volid': '7dc2fa17-1de9-4ed5-9ede-edf116c2686c', 'source_volstatus': 'available'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:23.558388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c58b890-41c1-49d4-beb5-b63c23eb2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:23.573058 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Volume volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f (f6c9c3ed-8cc5-42e3-b262-16b86647f94f): created successfully
Oct 08 21:22:23.587805 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c58b890-41c1-49d4-beb5-b63c23eb2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:23.593064 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (d2b624a1-cdad-418b-bedf-533285379c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:23.608598 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-64828948-e694-4463-b132-3f6b3bb17586 tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:25.452931 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:25.476894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (86de0e37-cf1d-4365-ace1-2f06a83de842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:25.487855 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0bb94a7-996b-4b59-a3ee-95483229a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.512038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0bb94a7-996b-4b59-a3ee-95483229a47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-287240292',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=93ea10f7-75e3-4543-a4bf-a0eee38c8378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:25Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.520447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddf4fb8-b69e-4a14-93f7-9b25bd7fc684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.528022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddf4fb8-b69e-4a14-93f7-9b25bd7fc684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.534316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767edb2d-bc68-4abe-86e8-7ad42feef11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.548811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767edb2d-bc68-4abe-86e8-7ad42feef11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ea10f7-75e3-4543-a4bf-a0eee38c8378', 'volume_name': 'volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.554054 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c47e117-fa36-47e2-ad89-195f665724ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.559923 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c47e117-fa36-47e2-ad89-195f665724ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.565894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a7ddee-29fd-422c-8fe3-392e6202d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.567494 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Volume 93ea10f7-75e3-4543-a4bf-a0eee38c8378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378', 'volume_size': 1}
Oct 08 21:22:25.568175 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] creating volume 'volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:22:25.568998 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:25.683708 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:25.684078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:25.687839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a7ddee-29fd-422c-8fe3-392e6202d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.692320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c23bd9e-8c9e-4871-983f-2a7dfa422ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:25.702806 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Volume volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378 (93ea10f7-75e3-4543-a4bf-a0eee38c8378): created successfully
Oct 08 21:22:25.707983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c23bd9e-8c9e-4871-983f-2a7dfa422ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:25.718063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (86de0e37-cf1d-4365-ace1-2f06a83de842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:25.730255 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-32caca4d-3f23-4032-8534-560abc7c48c6 tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:26.556059 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-93ea10f7-75e3-4543-a4bf-a0eee38c8378-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:26.578546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Lock "cinder-93ea10f7-75e3-4543-a4bf-a0eee38c8378-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:26.632033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:26.687284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:26.687703 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Volume volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:26.691783 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-93ea10f7-75e3-4543-a4bf-a0eee38c8378 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:26.991325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Created reservations ['8d2237b1-14ae-4860-937e-c6c29aa3b232', 'ad63e175-f84f-4ddc-9cc2-24ca0511fb5f', 'b72e8b01-ba59-4165-9ac8-03bebda1782c', '631ab4d8-4a4d-4d7d-b09a-f4e6ef5b91f3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:27.104907 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:27.160057 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:27.231349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:27.237077 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:27.253538 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4a109a44-2936-494b-81c1-ac976b226acc tempest-VolumesGetTest-1286211129 None] Lock "cinder-93ea10f7-75e3-4543-a4bf-a0eee38c8378-delete_volume" released by "delete_volume" :: held 0.675s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:27.735898 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-f6c9c3ed-8cc5-42e3-b262-16b86647f94f-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:27.760640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Lock "cinder-f6c9c3ed-8cc5-42e3-b262-16b86647f94f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:27.823909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:27.907840 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:27.916644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:28.256793 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:22:28.279503 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Volume volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:28.280349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] deleting parent snapshot volume-f6c9c3ed-8cc5-42e3-b262-16b86647f94f.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:22:29.283148 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=62,cinder:UPDATE=32,cinder:DELETE=5,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:29.294829 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=58,cinder:INSERT=11,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:29.308403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Created reservations ['f71108cc-9992-466f-8d88-4c3112dbf37a', '88f56fd9-ec1c-42d4-8838-92ef2aa93a23', 'b566fbb5-c400-4e68-8e30-dcca29a44a90', 'fc690549-3317-45d2-b519-ab227d8db246'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:29.362085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:29.393520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:29.444572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:29.450711 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:29.464896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4b2d9d6e-6f79-4849-abc1-e7fbd350e87e tempest-VolumesGetTest-1286211129 None] Lock "cinder-f6c9c3ed-8cc5-42e3-b262-16b86647f94f-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:30.638668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:30.672825 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (09ae4617-7322-4a23-91e1-f35c12e08419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:30.683142 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbbd8f1-8e03-468b-ae7b-048e86df3bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:30.702507 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbbd8f1-8e03-468b-ae7b-048e86df3bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1886897691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c39b005b-cb9b-4080-b65d-24e72229dae7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:31Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:30.708238 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0479cb-714f-42a5-8e87-e29d8e2e853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:30.713582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0479cb-714f-42a5-8e87-e29d8e2e853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:30.720710 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5503115f-c8c1-4309-a357-ef925154a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:30.852083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5503115f-c8c1-4309-a357-ef925154a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c39b005b-cb9b-4080-b65d-24e72229dae7', 'volume_name': 'volume-c39b005b-cb9b-4080-b65d-24e72229dae7', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b237040>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:30.858116 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f752d-65b9-497f-9de1-3e1775fd846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:30.862275 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f752d-65b9-497f-9de1-3e1775fd846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:30.867289 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd327241-6a76-43e9-b231-b47a771c5b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:30.871881 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Volume c39b005b-cb9b-4080-b65d-24e72229dae7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c39b005b-cb9b-4080-b65d-24e72229dae7', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b237040>}
Oct 08 21:22:30.872460 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Cloning c39b005b-cb9b-4080-b65d-24e72229dae7 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:22:30.873219 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:30.882022 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:30.892757 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 22, 30, 886728)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:22:30.893535 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:22:30.894943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:22:30.899974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:30.900812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:22:30.908978 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 22, 30, 905966)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:22:30.909717 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:22:30.911139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:22:30.927743 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:30.988225 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] creating snapshot='volume-c39b005b-cb9b-4080-b65d-24e72229dae7.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:22:31.311634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-c39b005b-cb9b-4080-b65d-24e72229dae7.clone_snap' to 'volume-c39b005b-cb9b-4080-b65d-24e72229dae7' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:22:31.483386 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:31.489474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:31.489474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:31.516985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:22:31.519287 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Marking volume c39b005b-cb9b-4080-b65d-24e72229dae7 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:22:31.528299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to c39b005b-cb9b-4080-b65d-24e72229dae7. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:22:31.529137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Creating volume glance metadata for volume c39b005b-cb9b-4080-b65d-24e72229dae7 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:22:31.654686 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd327241-6a76-43e9-b231-b47a771c5b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39b005b-cb9b-4080-b65d-24e72229dae7', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b237040>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:31.670684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d020cf53-bc27-417c-a299-710ced4f6290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:31.690836 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Volume volume-c39b005b-cb9b-4080-b65d-24e72229dae7 (c39b005b-cb9b-4080-b65d-24e72229dae7): created successfully
Oct 08 21:22:31.699924 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d020cf53-bc27-417c-a299-710ced4f6290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:31.711287 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (09ae4617-7322-4a23-91e1-f35c12e08419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:31.728986 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b2a9fe3b-6f52-45f0-84ff-56b3d8edfadb tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:33.462465 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:22:33.497049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (eb46d7fb-3b93-4d19-8ec6-ab7121c23242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:33.506452 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406790e-f98e-4712-a3fd-e9ce7a5dcb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.525320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a406790e-f98e-4712-a3fd-e9ce7a5dcb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:22:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-192243028',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5186f4bdb40744599fddf443f05c9824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:22:33Z,use_quota=True,user_id='4db99ab4d71a4b9e99d509dc243f4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.531903 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa90187b-e53e-49e5-ad2a-a4f28365d399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.537338 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa90187b-e53e-49e5-ad2a-a4f28365d399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.545773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de5050-2f42-404a-bb31-3b7157631bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.553221 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de5050-2f42-404a-bb31-3b7157631bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc', 'volume_name': 'volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.559849 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082d9a18-e6f1-40be-8460-2f00a45ce03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.566345 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082d9a18-e6f1-40be-8460-2f00a45ce03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.573423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6fff2-6a68-4374-af7e-5195ba8f8a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.574782 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Volume 0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc', 'volume_size': 1}
Oct 08 21:22:33.575562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] creating volume 'volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:22:33.576562 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:33.695055 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:22:33.695426 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:22:33.702568 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6fff2-6a68-4374-af7e-5195ba8f8a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.711404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4345a0ca-3d5a-4c97-9fae-561f5fd49b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:22:33.727918 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Volume volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc (0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc): created successfully
Oct 08 21:22:33.736687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4345a0ca-3d5a-4c97-9fae-561f5fd49b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:22:33.749051 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Flow 'volume_create_manager' (eb46d7fb-3b93-4d19-8ec6-ab7121c23242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:22:33.765888 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e55d8c7f-92f3-4038-bf7c-94caf0515c97 tempest-VolumesGetTest-1286211129 None] Created volume successfully.
Oct 08 21:22:35.016689 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:35.037891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Lock "cinder-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:35.114768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:35.193995 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:35.194452 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Volume volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:35.200159 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:35.512066 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Created reservations ['c02104ed-4206-4831-9ae2-2c07972d213b', '1a70ed94-efb9-4830-b960-959badb4a0d3', '609361d8-a9f6-4aa0-bc6c-de641189eab7', 'a135cf8c-e119-49ec-bfbf-fed64d527cd9'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:35.579542 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:35.656125 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:35.719811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:35.726421 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:35.744848 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8bd85790-5c84-4e8d-b355-a6a23e9581dc tempest-VolumesGetTest-1286211129 None] Lock "cinder-0c554a9f-51e9-4d4d-86e8-a645c9eaf1fc-delete_volume" released by "delete_volume" :: held 0.707s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:36.245500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-c39b005b-cb9b-4080-b65d-24e72229dae7-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:36.271447 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Lock "cinder-c39b005b-cb9b-4080-b65d-24e72229dae7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:36.360426 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:36.453425 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:36.465969 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-c39b005b-cb9b-4080-b65d-24e72229dae7 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:36.837693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:22:36.876183 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] deleting parent snapshot volume-c39b005b-cb9b-4080-b65d-24e72229dae7.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:22:37.482840 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Created reservations ['f036831e-dc29-471c-9a58-13cf2c402f25', '880ddb99-6f4d-4d93-8b33-c4f25e6f20cf', '567c1b68-74d9-45eb-8b30-14af9f95a75f', '53a94cf5-b79f-41d1-8b3c-2c0e31d87e46'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:37.578932 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:37.650858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:37.692059 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:37.702030 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:37.724632 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-976b934d-66d5-496f-a4e3-886ca08314c3 tempest-VolumesGetTest-1286211129 None] Lock "cinder-c39b005b-cb9b-4080-b65d-24e72229dae7-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:38.700061 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Acquiring lock "cinder-7dc2fa17-1de9-4ed5-9ede-edf116c2686c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:22:38.716882 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Lock "cinder-7dc2fa17-1de9-4ed5-9ede-edf116c2686c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:22:38.761217 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:38.864149 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:22:38.864996 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Volume volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:22:38.877750 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] deleting rbd volume volume-7dc2fa17-1de9-4ed5-9ede-edf116c2686c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:22:39.215909 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=57,cinder:INSERT=18,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:39.224887 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=36,cinder:SELECT=56,cinder:INSERT=6,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:22:39.252011 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Created reservations ['de8e5ed1-ae95-468a-9f53-14bc334a935e', '3698dce8-21af-47b8-84b2-4051692614b8', 'd0cac0e0-0211-4552-a969-4966115d6b16', '16b0708b-84d6-45e7-8900-8df792cf43a8'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:22:39.322270 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:39.376980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:22:39.423785 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:22:39.429780 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Deleted volume successfully.
Oct 08 21:22:39.455870 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-439720b7-a142-47db-ae5f-54fa082ef95f tempest-VolumesGetTest-1286211129 None] Lock "cinder-7dc2fa17-1de9-4ed5-9ede-edf116c2686c-delete_volume" released by "delete_volume" :: held 0.739s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:22:53.331066 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:23:05.961544 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:23:05.961544 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:06.000169 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:06.036186 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:23:13.332248 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:23:33.330388 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:23:49.412920 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:23:49.427983 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:23:49.447298 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Flow 'volume_create_manager' (1220bea7-b2d7-49b3-bfe0-f6c3e7eb8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:23:49.453555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d985d2-05a8-4d7b-b427-4c8860d8d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.470748 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d985d2-05a8-4d7b-b427-4c8860d8d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1388727409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb82154e-1cf4-498d-a133-85f98f9b4485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1015ad52f50940ddacb26dff52eafd2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:23:49Z,use_quota=True,user_id='1596d81500d04ff9bc593b57750cd60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.476638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e83709-7878-4ff5-9234-2fc14c5cd995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.481021 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e83709-7878-4ff5-9234-2fc14c5cd995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.486241 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362dd641-2900-4103-94a4-beba2b798043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.490334 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362dd641-2900-4103-94a4-beba2b798043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb82154e-1cf4-498d-a133-85f98f9b4485', 'volume_name': 'volume-eb82154e-1cf4-498d-a133-85f98f9b4485', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.495401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631db46d-e5a3-407a-967f-b4945ca0a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.499234 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631db46d-e5a3-407a-967f-b4945ca0a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.503867 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d17ef7-8b2d-4ab0-a441-fb1fc24ddf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.505081 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Volume eb82154e-1cf4-498d-a133-85f98f9b4485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb82154e-1cf4-498d-a133-85f98f9b4485', 'volume_size': 1}
Oct 08 21:23:49.505606 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] creating volume 'volume-eb82154e-1cf4-498d-a133-85f98f9b4485' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:23:49.506385 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:49.552623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:23:49.552990 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:23:49.556707 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d17ef7-8b2d-4ab0-a441-fb1fc24ddf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb82154e-1cf4-498d-a133-85f98f9b4485', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.561154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c018454c-c4ba-4a5f-8b88-76791cddcb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:23:49.571120 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Volume volume-eb82154e-1cf4-498d-a133-85f98f9b4485 (eb82154e-1cf4-498d-a133-85f98f9b4485): created successfully
Oct 08 21:23:49.574633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c018454c-c4ba-4a5f-8b88-76791cddcb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:23:49.580016 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Flow 'volume_create_manager' (1220bea7-b2d7-49b3-bfe0-f6c3e7eb8377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:23:49.588825 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ec3d9aba-36f6-415b-99a9-000f1c1a904e tempest-VolumesDeleteCascade-1702817464 None] Created volume successfully.
Oct 08 21:23:50.649127 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d00e8ac0-80fd-437a-9514-0ead0e1ef920 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:51.680006 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d00e8ac0-80fd-437a-9514-0ead0e1ef920 tempest-VolumesDeleteCascade-1702817464 None] Create snapshot completed successfully
Oct 08 21:23:52.870283 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5647c528-67f7-4497-a2c2-7bf7ac6881d3 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:53.700106 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5647c528-67f7-4497-a2c2-7bf7ac6881d3 tempest-VolumesDeleteCascade-1702817464 None] Create snapshot completed successfully
Oct 08 21:23:53.964669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Acquiring lock "cinder-eb82154e-1cf4-498d-a133-85f98f9b4485-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:23:53.973848 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-eb82154e-1cf4-498d-a133-85f98f9b4485-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:23:54.028311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Performing cascade delete. {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}}
Oct 08 21:23:54.038977 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Acquiring lock "cinder-3762d9bd-5eee-4996-8e18-6cb81788746f-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:23:54.051073 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-3762d9bd-5eee-4996-8e18-6cb81788746f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:23:54.066864 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:54.722894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Created reservations ['b13889ae-f2a2-44df-bb5a-cd6f38ee233c', '319866fa-9e29-4a99-9f68-54230e35efda', '78a0f0b0-a59a-48dd-b911-91e2f4da5c1e', 'c19e96a5-1b19-4c09-80b6-60c021a7645a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:23:54.759228 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Delete snapshot completed successfully.
Oct 08 21:23:54.764209 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-3762d9bd-5eee-4996-8e18-6cb81788746f-delete_snapshot" released by "delete_snapshot" :: held 0.713s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:23:54.765152 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Acquiring lock "cinder-bfcdf73d-f46c-457b-b9cb-eb36d5214d20-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:23:54.772962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-bfcdf73d-f46c-457b-b9cb-eb36d5214d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:23:54.789315 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:55.751226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Created reservations ['310d21b1-89f2-4025-94d5-13d0b2734fba', 'f4e99543-f479-42bd-b2aa-30f2108d8c30', '477a7c27-1255-4f24-afdf-aa3f540022bd', '219d5d63-5e1a-48ac-ad1f-7e0dbef6ee2e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:23:55.791118 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Delete snapshot completed successfully.
Oct 08 21:23:55.797565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-bfcdf73d-f46c-457b-b9cb-eb36d5214d20-delete_snapshot" released by "delete_snapshot" :: held 1.024s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:23:55.798302 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Snapshots deleted, issuing volume delete {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}}
Oct 08 21:23:55.799878 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:55.865964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:23:55.866722 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Volume volume-eb82154e-1cf4-498d-a133-85f98f9b4485 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:23:55.878038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] deleting rbd volume volume-eb82154e-1cf4-498d-a133-85f98f9b4485 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:23:56.175367 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Created reservations ['7b0d2b31-b991-40b6-ba13-abdb8ccb492c', '086ee667-f861-4b55-94a5-29bb60631a2f', '25884000-17fe-4121-a916-872aab9f1790', '530cc060-3bb7-4ea6-9258-2d47687db9c2'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:23:56.235020 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:56.308569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:23:56.365979 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:23:56.386206 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Deleted volume successfully.
Oct 08 21:23:56.401048 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-6c48dd4e-a335-4675-8e42-9200b65dfa98 tempest-VolumesDeleteCascade-1702817464 None] Lock "cinder-eb82154e-1cf4-498d-a133-85f98f9b4485-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:24:01.904028 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:24:01.944561 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Flow 'volume_create_manager' (f2409711-5ad0-457f-bbee-2b0f8fbd0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:24:01.953901 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d371cde-7045-413f-be81-adf973861561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.004370 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d371cde-7045-413f-be81-adf973861561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-179708346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b64015b-98c7-464f-922b-06d2b3f655e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee6c047574247b6a1d23aa9c9926313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:24:02Z,use_quota=True,user_id='2d77744e7dfa48ee9eff5abb6db01ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.016595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e4d2b-17d1-42a3-bba6-5fdd29a90e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.029249 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e4d2b-17d1-42a3-bba6-5fdd29a90e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.035213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3eca0e-237e-47a8-8189-1520fd791b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.040892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3eca0e-237e-47a8-8189-1520fd791b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b64015b-98c7-464f-922b-06d2b3f655e2', 'volume_name': 'volume-2b64015b-98c7-464f-922b-06d2b3f655e2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.048649 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2277507-2d5f-458e-ac99-25066698542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.053131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2277507-2d5f-458e-ac99-25066698542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.058720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89783ec0-40a0-4365-8968-48ad2fc03145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.060368 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Volume 2b64015b-98c7-464f-922b-06d2b3f655e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b64015b-98c7-464f-922b-06d2b3f655e2', 'volume_size': 1}
Oct 08 21:24:02.061035 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] creating volume 'volume-2b64015b-98c7-464f-922b-06d2b3f655e2' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:24:02.062112 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:02.160085 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:24:02.161534 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:24:02.168925 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89783ec0-40a0-4365-8968-48ad2fc03145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b64015b-98c7-464f-922b-06d2b3f655e2', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.177368 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fdcead-ced2-44a9-ab51-dd5b5373323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:02.191447 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Volume volume-2b64015b-98c7-464f-922b-06d2b3f655e2 (2b64015b-98c7-464f-922b-06d2b3f655e2): created successfully
Oct 08 21:24:02.198282 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fdcead-ced2-44a9-ab51-dd5b5373323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:02.208033 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Flow 'volume_create_manager' (f2409711-5ad0-457f-bbee-2b0f8fbd0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:24:02.222627 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-100b1a12-990b-4eb6-8c7d-711d9b53453e tempest-VolumesTransfersTest-704421705 None] Created volume successfully.
Oct 08 21:24:03.698031 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=51,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:24:03.706306 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-78475d84-697c-4863-925a-72c9ea34082b tempest-VolumesTransfersTest-180920694 None] Transfer volume completed successfully.
Oct 08 21:24:04.174311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Acquiring lock "cinder-2b64015b-98c7-464f-922b-06d2b3f655e2-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:24:04.184592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Lock "cinder-2b64015b-98c7-464f-922b-06d2b3f655e2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:24:04.218727 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:04.265818 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:24:04.266275 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Volume volume-2b64015b-98c7-464f-922b-06d2b3f655e2 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:24:04.270438 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] deleting rbd volume volume-2b64015b-98c7-464f-922b-06d2b3f655e2 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:24:04.512223 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Created reservations ['709ac32b-6c69-43f9-8aff-f93baad96981', '2e5ad874-a4fa-4f64-88f6-e5b6387c997a', '30479107-b2e5-431e-a329-509dd889499f', '8c95d205-8053-40af-b83e-c3773c8e6769'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:24:04.517943 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=65,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:24:04.563098 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:04.593380 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:04.621750 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:24:04.627895 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Deleted volume successfully.
Oct 08 21:24:04.642623 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-ff35b892-72e9-469e-a596-0bb7b884dca2 tempest-VolumesTransfersTest-1818936981 None] Lock "cinder-2b64015b-98c7-464f-922b-06d2b3f655e2-delete_volume" released by "delete_volume" :: held 0.458s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:24:05.823222 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:24:05.875765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Flow 'volume_create_manager' (7c9282ef-a026-4c6b-a898-c58bed370954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:24:05.889500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d0a675-8c0e-4465-b406-7e946bd2b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:05.921808 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d0a675-8c0e-4465-b406-7e946bd2b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1001169288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c157198-a15c-40da-8a7c-5d6b21a4d0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee6c047574247b6a1d23aa9c9926313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:24:06Z,use_quota=True,user_id='2d77744e7dfa48ee9eff5abb6db01ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:05.928558 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb63e7-109e-42f0-b9e4-a4b0841c4ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:05.957848 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb63e7-109e-42f0-b9e4-a4b0841c4ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:05.965132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db1bd6-a44e-4d54-8088-1d61ff821fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:05.969217 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db1bd6-a44e-4d54-8088-1d61ff821fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c157198-a15c-40da-8a7c-5d6b21a4d0db', 'volume_name': 'volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:05.974010 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39041613-65bf-4e34-aaff-1fc0565edef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:05.978529 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39041613-65bf-4e34-aaff-1fc0565edef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:05.984321 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3063577-c7dd-4f96-83e1-210153a37263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:05.985482 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Volume 0c157198-a15c-40da-8a7c-5d6b21a4d0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db', 'volume_size': 1}
Oct 08 21:24:05.985838 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] creating volume 'volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:24:05.986630 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:06.038477 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:24:06.041976 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:06.123171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:24:06.123693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:24:06.128616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3063577-c7dd-4f96-83e1-210153a37263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:06.137274 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee0f9a1-562f-4d96-9817-3468bb8995e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:24:06.144435 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:06.206815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:24:06.218179 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Volume volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db (0c157198-a15c-40da-8a7c-5d6b21a4d0db): created successfully
Oct 08 21:24:06.225610 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee0f9a1-562f-4d96-9817-3468bb8995e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:24:06.232237 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Flow 'volume_create_manager' (7c9282ef-a026-4c6b-a898-c58bed370954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:24:06.247433 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-60c22079-9276-4dd1-9563-2b24d6e38628 tempest-VolumesTransfersTest-704421705 None] Created volume successfully.
Oct 08 21:24:07.047921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Acquiring lock "cinder-0c157198-a15c-40da-8a7c-5d6b21a4d0db-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:24:07.064136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Lock "cinder-0c157198-a15c-40da-8a7c-5d6b21a4d0db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:24:07.108422 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:07.162076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:24:07.162901 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Volume volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:24:07.170812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] deleting rbd volume volume-0c157198-a15c-40da-8a7c-5d6b21a4d0db {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:24:07.434871 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Created reservations ['1772be2e-4638-4536-af45-25529deddb3d', '01ba29f1-e8b8-4784-9ca2-6a6c05b58e4e', '65e270f8-bf3d-4bea-a1f5-dd9345d9e5cc', '559475c1-800d-47e3-bf63-63312e21a643'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:24:07.536685 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:07.604836 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:24:07.652997 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:24:07.657164 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Deleted volume successfully.
Oct 08 21:24:07.676214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3d9ea816-d0ca-4f3c-9e2e-e726bf1fbb95 tempest-VolumesTransfersTest-1818936981 None] Lock "cinder-0c157198-a15c-40da-8a7c-5d6b21a4d0db-delete_volume" released by "delete_volume" :: held 0.612s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:24:23.348862 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:24:43.345621 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=41,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:25:06.038555 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:25:06.039246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:06.067117 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:06.098764 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:25:13.352890 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:25:28.445505 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:25:28.459198 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:25:28.496427 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (09375a78-77a1-4bf0-a8f1-23636b10a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:28.503087 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9682e758-55f4-40a2-89ba-4b97611cdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.525333 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9682e758-55f4-40a2-89ba-4b97611cdffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-552736106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cc8ec713-6bf9-4647-b376-a29a4d373cb4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='068e58c58aaf42c3b58197042d0026ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:25:28Z,use_quota=True,user_id='df864d8a6979495b945a6fdb4108f0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.530937 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6043a6f0-f9d4-4879-a886-f39add9f24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.535164 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6043a6f0-f9d4-4879-a886-f39add9f24c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.540765 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e981ac-5116-4f4a-b296-316e68740fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.544817 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e981ac-5116-4f4a-b296-316e68740fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8ec713-6bf9-4647-b376-a29a4d373cb4', 'volume_name': 'volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.549640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43f577d-5270-4e96-9e9c-d079ec9cd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.554036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43f577d-5270-4e96-9e9c-d079ec9cd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.559200 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356d598-9de0-4972-a30d-e00486819fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.560595 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Volume cc8ec713-6bf9-4647-b376-a29a4d373cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4', 'volume_size': 1}
Oct 08 21:25:28.561097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] creating volume 'volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:25:28.561883 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:28.613423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:25:28.613800 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:25:28.618082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356d598-9de0-4972-a30d-e00486819fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.622533 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4599761a-bb8f-4b95-9002-0cd92252aa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:28.632473 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Volume volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4 (cc8ec713-6bf9-4647-b376-a29a4d373cb4): created successfully
Oct 08 21:25:28.636935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4599761a-bb8f-4b95-9002-0cd92252aa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:28.643104 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (09375a78-77a1-4bf0-a8f1-23636b10a838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:28.660586 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-446e6455-5102-4167-a0da-5aefcd53d3bf tempest-VolumesTestJSON-1864942771 None] Created volume successfully.
Oct 08 21:25:29.874985 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:25:29.895335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (c66ebf35-ab30-4763-843f-9af24a866e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:29.901519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a3e540-48b6-409f-b82f-b3c5e0eced97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:29.917891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a3e540-48b6-409f-b82f-b3c5e0eced97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-208535782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=29309fbc-7aec-438e-a519-56906244c6c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='068e58c58aaf42c3b58197042d0026ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:25:30Z,use_quota=True,user_id='df864d8a6979495b945a6fdb4108f0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:29.923014 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117769de-295d-46cf-bc18-f6e03a86346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:29.927049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117769de-295d-46cf-bc18-f6e03a86346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:29.932519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361df33-d384-47dd-ab53-8fba2c477c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:29.936474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361df33-d384-47dd-ab53-8fba2c477c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29309fbc-7aec-438e-a519-56906244c6c3', 'volume_name': 'volume-29309fbc-7aec-438e-a519-56906244c6c3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:29.941119 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2074645b-05a7-4d21-9a33-b4d522c85110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:29.945036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2074645b-05a7-4d21-9a33-b4d522c85110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:29.949592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc89341-ed11-4458-b512-562628d19d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:29.950640 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Volume 29309fbc-7aec-438e-a519-56906244c6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29309fbc-7aec-438e-a519-56906244c6c3', 'volume_size': 1}
Oct 08 21:25:29.951027 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] creating volume 'volume-29309fbc-7aec-438e-a519-56906244c6c3' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:25:29.951657 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:30.004779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:25:30.005267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:25:30.009140 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc89341-ed11-4458-b512-562628d19d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29309fbc-7aec-438e-a519-56906244c6c3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:30.014150 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b61315-853c-4e9a-9f0d-84cbd9aa1407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:30.023749 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Volume volume-29309fbc-7aec-438e-a519-56906244c6c3 (29309fbc-7aec-438e-a519-56906244c6c3): created successfully
Oct 08 21:25:30.027755 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b61315-853c-4e9a-9f0d-84cbd9aa1407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:30.033078 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (c66ebf35-ab30-4763-843f-9af24a866e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:30.042588 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-5ccfae98-6e16-44df-8823-f6847c10cebc tempest-VolumesTestJSON-1864942771 None] Created volume successfully.
Oct 08 21:25:31.418948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:25:31.440929 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (1d7cc1f1-d903-4b38-865c-7cb6b24e8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:31.448433 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731af8e-c42c-4a21-b08e-01ea286fa323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.466567 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731af8e-c42c-4a21-b08e-01ea286fa323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-978160107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c425b4ac-661d-47ec-a822-857e7482347d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='068e58c58aaf42c3b58197042d0026ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:25:31Z,use_quota=True,user_id='df864d8a6979495b945a6fdb4108f0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.473838 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5802d10-b960-42f2-b30c-1c372e4a4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.478811 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5802d10-b960-42f2-b30c-1c372e4a4e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.484721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8af525-3bee-43cb-a066-1eefec5b84a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.489974 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8af525-3bee-43cb-a066-1eefec5b84a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c425b4ac-661d-47ec-a822-857e7482347d', 'volume_name': 'volume-c425b4ac-661d-47ec-a822-857e7482347d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.496065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d241d15-fd23-48cf-a2f4-2f122338fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.500276 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d241d15-fd23-48cf-a2f4-2f122338fade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.505305 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d55966-5dde-4320-bf55-74ade93529e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.506707 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Volume c425b4ac-661d-47ec-a822-857e7482347d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c425b4ac-661d-47ec-a822-857e7482347d', 'volume_size': 1}
Oct 08 21:25:31.507101 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] creating volume 'volume-c425b4ac-661d-47ec-a822-857e7482347d' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:25:31.507935 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:31.606237 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:25:31.606963 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:25:31.611502 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d55966-5dde-4320-bf55-74ade93529e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c425b4ac-661d-47ec-a822-857e7482347d', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.617987 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266a5084-cceb-49e0-89a5-b1e347f2dad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:25:31.632241 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Volume volume-c425b4ac-661d-47ec-a822-857e7482347d (c425b4ac-661d-47ec-a822-857e7482347d): created successfully
Oct 08 21:25:31.636954 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266a5084-cceb-49e0-89a5-b1e347f2dad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:25:31.646583 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Flow 'volume_create_manager' (1d7cc1f1-d903-4b38-865c-7cb6b24e8caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:25:31.666942 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b3e4bfa8-f2db-41dd-b891-15e91d18255a tempest-VolumesTestJSON-1864942771 None] Created volume successfully.
Oct 08 21:25:33.752963 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Acquiring lock "cinder-c425b4ac-661d-47ec-a822-857e7482347d-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:25:33.772789 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Lock "cinder-c425b4ac-661d-47ec-a822-857e7482347d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:25:33.833296 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:33.940795 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:25:33.941504 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Volume volume-c425b4ac-661d-47ec-a822-857e7482347d is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:25:33.951075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] deleting rbd volume volume-c425b4ac-661d-47ec-a822-857e7482347d {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:25:34.310984 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Created reservations ['75c41873-a12d-4fe6-873a-b0279f0e9a41', 'c4bf63f0-0a6c-41bd-a672-fd64441f2b67', '0c0f8b28-7310-4c8c-84a7-87d59cc89efb', 'b9a9a5ed-597e-475d-9c9e-062e29e396bb'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:25:34.370003 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:34.424669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:34.478455 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:25:34.495279 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Deleted volume successfully.
Oct 08 21:25:34.509178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-0a2e6b8d-6ccb-4a1d-b336-e6ce137d3497 tempest-VolumesTestJSON-1864942771 None] Lock "cinder-c425b4ac-661d-47ec-a822-857e7482347d-delete_volume" released by "delete_volume" :: held 0.737s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:25:34.951842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Acquiring lock "cinder-29309fbc-7aec-438e-a519-56906244c6c3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:25:34.966162 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Lock "cinder-29309fbc-7aec-438e-a519-56906244c6c3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:25:35.036593 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:35.079379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:25:35.079896 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Volume volume-29309fbc-7aec-438e-a519-56906244c6c3 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:25:35.085684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] deleting rbd volume volume-29309fbc-7aec-438e-a519-56906244c6c3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:25:35.278687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Created reservations ['417ca597-8d9b-4ff9-8778-d2a6b5a257c7', '3972816d-c57d-4623-9f89-dee12e981d30', '0d49d7a8-0cb4-4862-8b64-197d0b5f68f0', '0847006a-5c00-466f-9fe1-96849906eac4'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:25:35.334270 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:35.378539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:35.424432 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:25:35.429294 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Deleted volume successfully.
Oct 08 21:25:35.443233 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-4dd94e71-6c16-48b2-aa26-110e974c43cd tempest-VolumesTestJSON-1864942771 None] Lock "cinder-29309fbc-7aec-438e-a519-56906244c6c3-delete_volume" released by "delete_volume" :: held 0.478s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:25:36.113874 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Acquiring lock "cinder-cc8ec713-6bf9-4647-b376-a29a4d373cb4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:25:36.124629 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Lock "cinder-cc8ec713-6bf9-4647-b376-a29a4d373cb4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:25:36.163392 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:36.213836 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:25:36.214247 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Volume volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:25:36.219185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] deleting rbd volume volume-cc8ec713-6bf9-4647-b376-a29a4d373cb4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:25:36.417676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Created reservations ['5eb36e2c-4a01-4549-862a-3e29f07bff0f', '2382bc04-e73e-43ac-830f-527cae8accae', '1f87838e-a2a1-4560-9028-1bc8000aad94', 'c930552a-e36b-44f3-8bc4-72b5eb3d0a3d'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:25:36.458244 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:25:36.499076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:36.538326 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:25:36.582704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:25:36.588329 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Deleted volume successfully.
Oct 08 21:25:36.602179 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d5674a49-1f75-4368-8391-a4a3c0ec3932 tempest-VolumesTestJSON-1864942771 None] Lock "cinder-cc8ec713-6bf9-4647-b376-a29a4d373cb4-delete_volume" released by "delete_volume" :: held 0.477s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:25:53.366914 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:26:03.362909 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=43,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:26:06.043830 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:26:06.044761 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:26:06.074314 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:26:06.105702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:26:23.362916 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:26:33.370726 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:26:53.364065 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:27:03.365893 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:27:05.179352 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:27:05.198304 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Flow 'volume_create_manager' (c82aa848-a540-4338-80fd-34922ddaee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:27:05.204401 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01692080-c7e5-4bd8-baea-0cd76a9194ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.219856 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01692080-c7e5-4bd8-baea-0cd76a9194ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-910700490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d0b3adfd-e817-4f27-8ad3-0b90556937d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4075244a8af34cbc9c1c0ae398c7e639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:27:05Z,use_quota=True,user_id='839dedede3d643e4bb41ade33d54e7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.224927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddde38d-476b-4fc3-bfd1-34a18926f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.229369 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddde38d-476b-4fc3-bfd1-34a18926f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.234443 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a647836-c7ee-4b80-84fc-73e5b510a70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.238294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a647836-c7ee-4b80-84fc-73e5b510a70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b3adfd-e817-4f27-8ad3-0b90556937d1', 'volume_name': 'volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.242940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d5fa9-b1f6-4a63-9c0f-12e558c2a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.247301 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1d5fa9-b1f6-4a63-9c0f-12e558c2a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.251728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e02a0f-4879-4fdc-b144-6d74930afaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.252744 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Volume d0b3adfd-e817-4f27-8ad3-0b90556937d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1', 'volume_size': 1}
Oct 08 21:27:05.253138 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] creating volume 'volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:27:05.253876 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:05.299934 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:27:05.300299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:27:05.304162 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e02a0f-4879-4fdc-b144-6d74930afaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.309077 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc099f-bf70-4565-b707-961d9482f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:27:05.318672 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Volume volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1 (d0b3adfd-e817-4f27-8ad3-0b90556937d1): created successfully
Oct 08 21:27:05.322178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc099f-bf70-4565-b707-961d9482f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:27:05.327366 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Flow 'volume_create_manager' (c82aa848-a540-4338-80fd-34922ddaee70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:27:05.334913 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-ca95d96a-3037-4bd5-81f4-cb24715bd72b tempest-SnapshotsActionsTest-1971994170 None] Created volume successfully.
Oct 08 21:27:06.042706 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:27:06.043282 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:06.065965 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:06.089839 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:27:06.383913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b31cacec-656d-44e4-aced-22bb56413123 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:06.722802 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b31cacec-656d-44e4-aced-22bb56413123 tempest-SnapshotsActionsTest-1971994170 None] Create snapshot completed successfully
Oct 08 21:27:07.785208 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-0aefc709-b042-41c3-aaec-bfd9671212cf tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:08.732996 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-0aefc709-b042-41c3-aaec-bfd9671212cf tempest-SnapshotsActionsTest-1971994170 None] Create snapshot completed successfully
Oct 08 21:27:08.942785 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] Acquiring lock "cinder-4a437150-5ddc-48cb-b620-0bb910a8539d-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:08.957312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-4a437150-5ddc-48cb-b620-0bb910a8539d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:08.958706 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:09.763479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] Created reservations ['d8784464-c3ac-48df-8e8c-272630d8835d', '7f49be66-0fa6-4713-80af-45b53d6c561b', 'c737e672-1600-412b-9c31-a56826277137', '2d7547c6-45d5-4e79-bed2-fda6fd55e7ff'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:09.799449 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] Delete snapshot completed successfully.
Oct 08 21:27:09.803909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-32b6a800-428f-4e20-bbee-a301f6a14b93 tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-4a437150-5ddc-48cb-b620-0bb910a8539d-delete_snapshot" released by "delete_snapshot" :: held 0.847s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:10.250572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-aff60224-7923-4797-b141-0673cafcb808 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:10.758135 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-aff60224-7923-4797-b141-0673cafcb808 tempest-SnapshotsActionsTest-1971994170 None] Create snapshot completed successfully
Oct 08 21:27:11.389297 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] Acquiring lock "cinder-afe961e3-6b5b-4d59-8605-c466c64a0623-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:11.402299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-afe961e3-6b5b-4d59-8605-c466c64a0623-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:11.404201 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:11.787308 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] Created reservations ['e4aab270-99d0-475e-bed0-687f20d71bef', 'df68bd50-0ad5-472d-8db3-75b5095c386f', '72f1874d-009b-426a-9711-2690d8ccd1e6', '2e1637f7-cc8e-4b77-b268-a195751e855b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:11.821699 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] Delete snapshot completed successfully.
Oct 08 21:27:11.826436 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-3c84e50a-fb07-4707-a550-0ed1985b42cd tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-afe961e3-6b5b-4d59-8605-c466c64a0623-delete_snapshot" released by "delete_snapshot" :: held 0.424s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:12.715628 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-203dfa33-72c0-4b3a-9c0d-062e4088b263 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:13.786331 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-203dfa33-72c0-4b3a-9c0d-062e4088b263 tempest-SnapshotsActionsTest-1971994170 None] Create snapshot completed successfully
Oct 08 21:27:14.877668 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] Acquiring lock "cinder-ca960453-f7bb-4d25-b885-dd80bcc730ae-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:14.887846 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-ca960453-f7bb-4d25-b885-dd80bcc730ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:14.889311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:15.825980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] Created reservations ['103042e6-a636-46d9-88a2-851e0251170f', 'dee4bcb1-f7d6-484a-9a48-6124b9dd2698', '42d09c15-d023-4881-a21a-2569929a1789', 'd8d8f5b1-4ae3-4290-833b-40fb128e92df'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:15.861869 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] Delete snapshot completed successfully.
Oct 08 21:27:15.866281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cfd78c5a-74d9-48f7-9fd0-7d081cd3d2f8 tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-ca960453-f7bb-4d25-b885-dd80bcc730ae-delete_snapshot" released by "delete_snapshot" :: held 0.978s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:16.185572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-962a3d87-db65-4105-9418-e5f160047886 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:16.833132 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-962a3d87-db65-4105-9418-e5f160047886 tempest-SnapshotsActionsTest-1971994170 None] Create snapshot completed successfully
Oct 08 21:27:17.328387 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] Acquiring lock "cinder-e47ec80d-2706-4074-bd01-2b48ef7a433e-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:17.337488 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-e47ec80d-2706-4074-bd01-2b48ef7a433e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:17.339013 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:17.639017 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=69,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:27:17.669442 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] Created reservations ['52a6b09b-a14a-4284-9ff5-89285f1ee2c0', '0db67570-a2e0-4cc6-83ac-9517c80e9bfe', '35b90571-c75d-442c-8490-d1ff13aa19b3', 'ef68642d-36d9-42fd-9995-5bddb2a02f82'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:17.702549 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:27:17.707766 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] Delete snapshot completed successfully.
Oct 08 21:27:17.713087 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-97b68f70-7e04-422f-8498-7e5ff802b8bf tempest-SnapshotsActionsTest-2135829515 None] Lock "cinder-e47ec80d-2706-4074-bd01-2b48ef7a433e-delete_snapshot" released by "delete_snapshot" :: held 0.376s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:18.800829 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] Acquiring lock "cinder-f7c16f95-a118-426a-9cfa-728572ba4efa-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:18.815188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] Lock "cinder-f7c16f95-a118-426a-9cfa-728572ba4efa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:18.816957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:19.869695 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] Created reservations ['d6c51444-234f-4a30-935e-178b84321706', '9981328d-9e33-4274-b0a9-7e68086a498e', '6929df17-d7fe-48cc-8d70-d0b7b42f57d2', 'fab6ae8e-38c3-481f-bf42-5bbbc6507b0e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:19.904529 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] Delete snapshot completed successfully.
Oct 08 21:27:19.908917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d901b763-c112-42dc-9cfa-e39a9de30c5f tempest-SnapshotsActionsTest-1971994170 None] Lock "cinder-f7c16f95-a118-426a-9cfa-728572ba4efa-delete_snapshot" released by "delete_snapshot" :: held 1.094s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:20.927532 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Acquiring lock "cinder-d0b3adfd-e817-4f27-8ad3-0b90556937d1-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:27:20.937423 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Lock "cinder-d0b3adfd-e817-4f27-8ad3-0b90556937d1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:27:20.970207 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:21.005716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:27:21.006145 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Volume volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:27:21.010619 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] deleting rbd volume volume-d0b3adfd-e817-4f27-8ad3-0b90556937d1 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:27:21.170921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Created reservations ['3c1f2458-3dfe-49fb-a863-1b9b0fba494b', 'db42057c-c85c-4718-be8c-9e4e0e04f8c6', '879b3f72-c280-40a5-9612-23917568cbe1', '9fc7e5bc-5b51-4f72-b495-c8e5d6f59875'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:27:21.216080 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:21.243605 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:27:21.268931 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:27:21.273207 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Deleted volume successfully.
Oct 08 21:27:21.285932 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-68ecbdd1-25f4-4d8e-998c-33c52b315427 tempest-SnapshotsActionsTest-1971994170 None] Lock "cinder-d0b3adfd-e817-4f27-8ad3-0b90556937d1-delete_volume" released by "delete_volume" :: held 0.348s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:27:33.366626 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:27:53.364841 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:INSERT=7,cinder:SELECT=24,cinder:UPDATE=19 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:28:06.044618 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:28:06.045302 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:28:06.069536 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:28:06.092658 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:28:13.366661 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:28:23.369849 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:28:33.373862 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:28:43.374914 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:29:03.378497 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:29:06.048065 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:29:06.048720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:29:06.072579 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:29:06.095979 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:29:13.384906 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:29:33.389875 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:29:43.394628 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:29:53.402934 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:30:06.051595 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:30:06.052250 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:30:06.075444 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:30:06.098349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:30:13.404032 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:30:33.411469 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:30:33.413153 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:30:53.420395 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:31:03.423492 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:31:06.053091 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:31:06.053772 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:31:06.077582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:31:06.100153 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:31:23.430002 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:31:33.435152 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:31:53.442555 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:31:53.444691 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:32:06.055031 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:32:06.055675 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:32:06.079947 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:32:06.103913 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:32:23.449032 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:32:23.452504 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:32:28.639131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:32:28.657736 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Flow 'volume_create_manager' (1b31eb81-4496-4183-af84-7bb22da71f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:28.663888 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adab9bf8-f599-4bf8-bfe0-0610d2503d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:28.679337 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adab9bf8-f599-4bf8-bfe0-0610d2503d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1161385914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=69230254-02a4-4b48-82bf-c2a70eba1591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c13f3a9d12c4710882a17d9d06b3473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:32:29Z,use_quota=True,user_id='0f0e898ea13845068ead117311106b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:28.685643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b04716-1880-4507-94d4-40d6d80af7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:28.689687 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b04716-1880-4507-94d4-40d6d80af7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:28.694476 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b039ef14-6535-455a-b050-5e576450a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:28.773890 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b039ef14-6535-455a-b050-5e576450a387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69230254-02a4-4b48-82bf-c2a70eba1591', 'volume_name': 'volume-69230254-02a4-4b48-82bf-c2a70eba1591', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eb5e20>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:28.778803 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49805259-95d9-4c73-a01c-5ef7d3689214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:28.782671 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49805259-95d9-4c73-a01c-5ef7d3689214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:28.787194 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9874423-f685-4d91-b0db-9a4e68fcbb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:28.788291 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Volume 69230254-02a4-4b48-82bf-c2a70eba1591: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69230254-02a4-4b48-82bf-c2a70eba1591', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eb5e20>}
Oct 08 21:32:28.788857 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Cloning 69230254-02a4-4b48-82bf-c2a70eba1591 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:32:28.789628 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:32:28.797863 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:32:28.809356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 32, 28, 803805)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:32:28.809775 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:32:28.810174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:32:28.814571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:32:28.815384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:32:28.821126 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 32, 28, 818822)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:32:28.822104 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:32:28.822499 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:32:28.854256 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:32:28.900842 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] creating snapshot='volume-69230254-02a4-4b48-82bf-c2a70eba1591.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:32:29.239799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-69230254-02a4-4b48-82bf-c2a70eba1591.clone_snap' to 'volume-69230254-02a4-4b48-82bf-c2a70eba1591' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:32:29.373749 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:32:29.375068 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:32:29.375478 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:32:29.399400 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:32:29.400136 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Marking volume 69230254-02a4-4b48-82bf-c2a70eba1591 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:32:29.410616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 69230254-02a4-4b48-82bf-c2a70eba1591. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:32:29.411100 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Creating volume glance metadata for volume 69230254-02a4-4b48-82bf-c2a70eba1591 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:32:29.488654 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9874423-f685-4d91-b0db-9a4e68fcbb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69230254-02a4-4b48-82bf-c2a70eba1591', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eb5e20>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:29.495916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f43ac-42f2-4bd1-8b75-9d5d4f0a3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:29.507527 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Volume volume-69230254-02a4-4b48-82bf-c2a70eba1591 (69230254-02a4-4b48-82bf-c2a70eba1591): created successfully
Oct 08 21:32:29.513008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f43ac-42f2-4bd1-8b75-9d5d4f0a3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:29.520914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Flow 'volume_create_manager' (1b31eb81-4496-4183-af84-7bb22da71f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:29.530760 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-39c37537-9e59-449a-a3cf-f989582588fb tempest-TestVolumeBackupRestore-199632938 None] Created volume successfully.
Oct 08 21:32:29.957410 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-08T21:32:29Z,data_timestamp=2022-10-08T21:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ca5ad4e8-e59d-4d70-b203-fc0fee50a120,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5c13f3a9d12c4710882a17d9d06b3473',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='0f0e898ea13845068ead117311106b0c',volume_id=69230254-02a4-4b48-82bf-c2a70eba1591)
Oct 08 21:32:29.958185 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.backup.rpcapi [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] continue_backup in rpcapi backup_id ca5ad4e8-e59d-4d70-b203-fc0fee50a120 {{(pid=133344) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 08 21:32:30.046668 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:32:30.817734 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:32:30.818777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-69230254-02a4-4b48-82bf-c2a70eba1591', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '69230254-02a4-4b48-82bf-c2a70eba1591', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:32:30.835139 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] Initialize volume connection completed successfully.
Oct 08 21:32:35.624619 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] Terminate volume connection completed successfully.
Oct 08 21:32:35.643354 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-7c7a0c87-d97f-4420-9939-9d0abf359b41 tempest-TestVolumeBackupRestore-199632938 None] Remove volume export completed successfully.
Oct 08 21:32:36.521024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:32:36.541217 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Flow 'volume_create_manager' (cd132374-bfea-4bd3-b20b-ab0c74de6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:36.547483 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c739ed8-441e-4b54-a141-76a8a1fa2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.563123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c739ed8-441e-4b54-a141-76a8a1fa2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:32:36Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ca5ad4e8-e59d-4d70-b203-fc0fee50a120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=67154ed5-2fda-4ed4-9784-d919a9ecdfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c13f3a9d12c4710882a17d9d06b3473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:32:36Z,use_quota=True,user_id='0f0e898ea13845068ead117311106b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.568202 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0cdf3-648f-4900-91a0-23d5318bb664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.572729 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0cdf3-648f-4900-91a0-23d5318bb664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.577589 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731421c1-6081-4ba9-8c22-5fec7114555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.581479 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731421c1-6081-4ba9-8c22-5fec7114555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'volume_name': 'volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.586139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8836c4f8-633f-4f84-a9c7-bbc643ae10a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.590618 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8836c4f8-633f-4f84-a9c7-bbc643ae10a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.595065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdcf6f2-b058-4dac-b88e-6ca66f1a1624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.596350 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Volume 67154ed5-2fda-4ed4-9784-d919a9ecdfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'volume_size': 1}
Oct 08 21:32:36.596770 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] creating volume 'volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:32:36.597915 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:32:36.671017 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:32:36.671017 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:32:36.671017 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdcf6f2-b058-4dac-b88e-6ca66f1a1624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.674029 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2bd41-87da-486c-9ca1-a3ab6f51d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:36.684548 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Volume volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3 (67154ed5-2fda-4ed4-9784-d919a9ecdfd3): created successfully
Oct 08 21:32:36.688176 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2bd41-87da-486c-9ca1-a3ab6f51d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:36.693545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Flow 'volume_create_manager' (cd132374-bfea-4bd3-b20b-ab0c74de6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:36.701905 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Created volume successfully.
Oct 08 21:32:37.571707 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:32:38.370762 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.799s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:32:38.371616 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:32:38.391678 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Initialize volume connection completed successfully.
Oct 08 21:32:42.827066 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Terminate volume connection completed successfully.
Oct 08 21:32:42.850502 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-4ec51254-7f67-49ec-b978-b15594407b8e tempest-TestVolumeBackupRestore-199632938 None] Remove volume export completed successfully.
Oct 08 21:32:48.644104 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1c0599a5-005c-4529-829a-c6d4aa38d905 req-a1fab669-5528-4633-a4b2-3dd907683e6c tempest-TestVolumeBackupRestore-199632938 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:32:49.444500 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1c0599a5-005c-4529-829a-c6d4aa38d905 req-a1fab669-5528-4633-a4b2-3dd907683e6c tempest-TestVolumeBackupRestore-199632938 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.800s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:32:49.446009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1c0599a5-005c-4529-829a-c6d4aa38d905 req-a1fab669-5528-4633-a4b2-3dd907683e6c tempest-TestVolumeBackupRestore-199632938 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:32:49.484071 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-1c0599a5-005c-4529-829a-c6d4aa38d905 req-a1fab669-5528-4633-a4b2-3dd907683e6c tempest-TestVolumeBackupRestore-199632938 None] Connection info returned from driver {'name': 'volumes/volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '67154ed5-2fda-4ed4-9784-d919a9ecdfd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8600b9e6-773f-47bc-aed0-ed52b8a19e99'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:32:49.561586 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-1c0599a5-005c-4529-829a-c6d4aa38d905 req-a1fab669-5528-4633-a4b2-3dd907683e6c tempest-TestVolumeBackupRestore-199632938 None] attachment_update completed successfully.
Oct 08 21:32:53.466016 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=39,cinder:UPDATE=8,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:32:53.468478 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=8,cinder:SELECT=49,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:32:58.032377 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:32:58.054395 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (44ace691-3d0f-45d8-9a75-646a144366d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:58.061165 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d010c03-13fe-4bdf-a83b-d042dd8a0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:58.077973 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d010c03-13fe-4bdf-a83b-d042dd8a0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1870503472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=87ed81a4-bc3c-4835-ba92-436183cb4ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:32:58Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:58.083250 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c0d8c4-f30e-4b1d-b008-b97ee93ba496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:58.087212 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c0d8c4-f30e-4b1d-b008-b97ee93ba496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:58.092024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a754068-a4dd-4d78-a95e-6cfef1d0fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:58.188955 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a754068-a4dd-4d78-a95e-6cfef1d0fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87ed81a4-bc3c-4835-ba92-436183cb4ee4', 'volume_name': 'volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44e43310>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:58.195482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5bd496-7d5a-4e06-92fa-716996571394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:58.199466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5bd496-7d5a-4e06-92fa-716996571394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:58.204395 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19448b6a-bafe-4b6c-a05d-a108b4ab7424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:58.205682 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Volume 87ed81a4-bc3c-4835-ba92-436183cb4ee4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44e43310>}
Oct 08 21:32:58.207230 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Cloning 87ed81a4-bc3c-4835-ba92-436183cb4ee4 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:32:58.208065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:32:58.216892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:32:58.230131 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 32, 58, 222221)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:32:58.230643 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:32:58.231219 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:32:58.240641 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:32:58.242335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:32:58.248655 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 32, 58, 246137)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:32:58.249073 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:32:58.249492 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:32:58.263915 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:32:58.324774 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] creating snapshot='volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:32:58.953815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4.clone_snap' to 'volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:32:59.087485 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:32:59.088693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:32:59.089083 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:32:59.106689 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:32:59.107376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Marking volume 87ed81a4-bc3c-4835-ba92-436183cb4ee4 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:32:59.116089 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 87ed81a4-bc3c-4835-ba92-436183cb4ee4. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:32:59.117069 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Creating volume glance metadata for volume 87ed81a4-bc3c-4835-ba92-436183cb4ee4 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:32:59.169816 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19448b6a-bafe-4b6c-a05d-a108b4ab7424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44e43310>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:59.174237 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e19a72-0501-4f0b-a04c-4c4b5a0ccccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:32:59.184025 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4 (87ed81a4-bc3c-4835-ba92-436183cb4ee4): created successfully
Oct 08 21:32:59.187653 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e19a72-0501-4f0b-a04c-4c4b5a0ccccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:32:59.193994 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (44ace691-3d0f-45d8-9a75-646a144366d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:32:59.204351 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-cf29baf1-6006-4222-9b0b-c3c9ff829043 tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:33:00.427990 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-6254dffa-7ff7-41c4-bba0-e377520e677b tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:01.039853 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-6254dffa-7ff7-41c4-bba0-e377520e677b tempest-TestVolumeBootPattern-1770467933 None] Create snapshot completed successfully
Oct 08 21:33:04.213374 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:33:04.257536 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (4a860dcd-30ce-4e5f-a7bc-29b5cb62445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:04.264173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884c4489-83dd-441c-b6a7-701a4298dc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.281993 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884c4489-83dd-441c-b6a7-701a4298dc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:33:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5af072d2-86ba-48f9-94c3-054df22ed212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de6e7b16-78e1-462c-a0b2-d3e5809f2605,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:33:04Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.287549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca48161-959f-488e-b888-7dd986724801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.292682 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca48161-959f-488e-b888-7dd986724801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.298126 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ceea88-5890-403f-bc45-af38d6bfa0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.302384 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ceea88-5890-403f-bc45-af38d6bfa0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5af072d2-86ba-48f9-94c3-054df22ed212', 'volume_name': 'volume-5af072d2-86ba-48f9-94c3-054df22ed212', 'volume_size': 1, 'snapshot_id': 'de6e7b16-78e1-462c-a0b2-d3e5809f2605'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.307400 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb75fae-ca80-4c3e-9326-aba9ef0a907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.311501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb75fae-ca80-4c3e-9326-aba9ef0a907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.316281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c11addb-631f-415e-9cc4-dfdf165bba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.317550 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Volume 5af072d2-86ba-48f9-94c3-054df22ed212: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5af072d2-86ba-48f9-94c3-054df22ed212', 'volume_size': 1, 'snapshot_id': 'de6e7b16-78e1-462c-a0b2-d3e5809f2605'}
Oct 08 21:33:04.339949 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] cloning volumes/volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4@snapshot-de6e7b16-78e1-462c-a0b2-d3e5809f2605 to volume-5af072d2-86ba-48f9-94c3-054df22ed212 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:33:04.340670 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:04.415885 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:04.603948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:33:04.606006 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:33:04.630906 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Marking volume 5af072d2-86ba-48f9-94c3-054df22ed212 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:33:04.641602 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from snapshot de6e7b16-78e1-462c-a0b2-d3e5809f2605 to 5af072d2-86ba-48f9-94c3-054df22ed212. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 08 21:33:04.690299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c11addb-631f-415e-9cc4-dfdf165bba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af072d2-86ba-48f9-94c3-054df22ed212', 'volume_size': 1, 'snapshot_id': 'de6e7b16-78e1-462c-a0b2-d3e5809f2605'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.700145 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a4f3c-1555-4d6c-8d59-3b0f0487fa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:04.716475 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Volume volume-5af072d2-86ba-48f9-94c3-054df22ed212 (5af072d2-86ba-48f9-94c3-054df22ed212): created successfully
Oct 08 21:33:04.721682 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a4f3c-1555-4d6c-8d59-3b0f0487fa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:04.727009 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (4a860dcd-30ce-4e5f-a7bc-29b5cb62445e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:04.742460 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-e5d62ac4-289d-40e0-a93d-30cb2820c3ab tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:33:06.058988 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:33:06.062079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:06.126824 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:06.226364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:07.543579 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-835fb24d-d1f5-47f0-9fb3-c56329523331 tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:33:08.288790 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-835fb24d-d1f5-47f0-9fb3-c56329523331 tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.745s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:33:08.289676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-835fb24d-d1f5-47f0-9fb3-c56329523331 tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5af072d2-86ba-48f9-94c3-054df22ed212', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '5af072d2-86ba-48f9-94c3-054df22ed212', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:33:08.313785 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-835fb24d-d1f5-47f0-9fb3-c56329523331 tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-5af072d2-86ba-48f9-94c3-054df22ed212', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5af072d2-86ba-48f9-94c3-054df22ed212', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f26fd7e9-3889-44f1-87f6-efe3a7b5aa1d'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:33:08.367497 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-a99ee953-3c40-4be6-b04a-ee0af6dd697e req-835fb24d-d1f5-47f0-9fb3-c56329523331 tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:33:18.366319 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=39,cinder:UPDATE=10,cinder:INSERT=17 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:19.467701 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-4f1d8db5-b689-4751-87f7-2efee63fd3cc tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:33:19.468651 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-4f1d8db5-b689-4751-87f7-2efee63fd3cc tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment f26fd7e9-3889-44f1-87f6-efe3a7b5aa1d. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:33:19.587047 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-5af072d2-86ba-48f9-94c3-054df22ed212-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:19.597410 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-5af072d2-86ba-48f9-94c3-054df22ed212-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:19.630639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:19.714176 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:33:19.720917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-5af072d2-86ba-48f9-94c3-054df22ed212 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:33:19.895786 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['0fe8ccd2-3eff-4037-a21a-8c7f58d3ada7', '11a67fd9-7318-484e-a62a-a3a358a7b2bc', '39d4d410-8641-4c15-90c8-c1a7d1a003a0', '3806b2a3-ec93-4229-9dac-8331f153362a'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:19.912877 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=64,cinder:UPDATE=12,cinder:INSERT=21,cinder:DELETE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:19.950282 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:19.984299 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:20.015211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:20.020135 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:33:20.033784 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-d68fb730-3ed1-4a48-b65e-9916c403b4b8 req-c5941661-3556-4f11-89fa-9b88820e9f09 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-5af072d2-86ba-48f9-94c3-054df22ed212-delete_volume" released by "delete_volume" :: held 0.436s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:21.113454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-de6e7b16-78e1-462c-a0b2-d3e5809f2605-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:21.122934 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-de6e7b16-78e1-462c-a0b2-d3e5809f2605-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:21.125815 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:22.124382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['578813e6-8463-421c-9843-84352d5ac5c7', '8dba62bb-586f-47e6-84dd-be2b266fdfd9', '1577f3c0-07c5-42e9-91ea-727e84bf5385', '564da43e-ba56-47aa-9452-b4f1b59edd79'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:22.167069 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] Delete snapshot completed successfully.
Oct 08 21:33:22.171549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-90d1ba5b-45dd-4db0-8c9a-75455794f96f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-de6e7b16-78e1-462c-a0b2-d3e5809f2605-delete_snapshot" released by "delete_snapshot" :: held 1.049s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:22.214814 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-87ed81a4-bc3c-4835-ba92-436183cb4ee4-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:22.223866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-87ed81a4-bc3c-4835-ba92-436183cb4ee4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:22.255505 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:22.315350 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:33:22.320641 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:33:22.472790 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:33:22.502957 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] deleting parent snapshot volume-87ed81a4-bc3c-4835-ba92-436183cb4ee4.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:33:23.126790 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['ee9f1d09-e401-4a2f-a2a0-7d22b778eb7d', 'e075b14e-9f4d-45be-b85a-839de7a6bb13', '41a0546f-85f0-4ed3-b057-0323469d2ea4', 'b97578fa-68e7-43d0-8d81-7e14c6921f78'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:23.170590 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:23.194521 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:23.219153 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:23.223302 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:33:23.236017 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-588e0f5f-8a00-4ac4-8ea9-da0ccdc04ef3 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-87ed81a4-bc3c-4835-ba92-436183cb4ee4-delete_volume" released by "delete_volume" :: held 1.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:23.782038 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:33:23.802361 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (269509af-26fb-43d4-b8b4-564adb4994d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:23.809448 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3db6446-c5b7-41d0-a652-ed2e2ecb1a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:23.828620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3db6446-c5b7-41d0-a652-ed2e2ecb1a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1211344187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=40d2e48f-3ae3-4ed6-8694-d04a58635bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:33:24Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:23.834274 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137d5751-2f43-4a18-9327-16ba044e1d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:23.839118 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137d5751-2f43-4a18-9327-16ba044e1d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:23.844810 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de61a3f-4ffd-4efa-abdf-02ca2c0077d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:23.927999 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de61a3f-4ffd-4efa-abdf-02ca2c0077d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'volume_name': 'volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eada00>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:23.933076 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35ad53c-f4ce-4601-8e51-53d03ca9cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:23.936852 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35ad53c-f4ce-4601-8e51-53d03ca9cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:23.941296 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf44086e-aadb-456d-812f-558feafd7133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:23.942373 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Volume 40d2e48f-3ae3-4ed6-8694-d04a58635bfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eada00>}
Oct 08 21:33:23.942929 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Cloning 40d2e48f-3ae3-4ed6-8694-d04a58635bfb from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:33:23.943828 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:23.951852 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:23.962232 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 33, 23, 956695)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:33:23.962661 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:33:23.963051 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:33:23.967246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:23.968412 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:33:23.974048 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 33, 23, 971787)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:33:23.974466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:33:23.974856 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:33:23.987347 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:24.036763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] creating snapshot='volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:33:24.094166 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb.clone_snap' to 'volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:33:24.199095 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:33:24.200803 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:33:24.201178 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:33:24.219155 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:33:24.220172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Marking volume 40d2e48f-3ae3-4ed6-8694-d04a58635bfb as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:33:24.228683 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 40d2e48f-3ae3-4ed6-8694-d04a58635bfb. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:33:24.229130 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Creating volume glance metadata for volume 40d2e48f-3ae3-4ed6-8694-d04a58635bfb backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:33:24.281065 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf44086e-aadb-456d-812f-558feafd7133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b44eada00>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:24.286645 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ebe448-d280-4c63-8f18-7b8054f7faec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:24.295265 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb (40d2e48f-3ae3-4ed6-8694-d04a58635bfb): created successfully
Oct 08 21:33:24.298914 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ebe448-d280-4c63-8f18-7b8054f7faec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:24.304446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (269509af-26fb-43d4-b8b4-564adb4994d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:24.312010 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-8cb775a4-170f-43fe-a091-a11ee76a6d84 tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:33:26.757234 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-c7547d2c-2403-4590-9be8-81e725d5e470 req-1a73995d-bed9-4809-aadb-6762d8264183 tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:33:27.573963 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-c7547d2c-2403-4590-9be8-81e725d5e470 req-1a73995d-bed9-4809-aadb-6762d8264183 tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.816s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:33:27.575108 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-c7547d2c-2403-4590-9be8-81e725d5e470 req-1a73995d-bed9-4809-aadb-6762d8264183 tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:33:27.598213 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:27.605439 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c7547d2c-2403-4590-9be8-81e725d5e470 req-1a73995d-bed9-4809-aadb-6762d8264183 tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '40d2e48f-3ae3-4ed6-8694-d04a58635bfb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '19a616ad-acd1-4233-9ecc-6d0efc7d8e78'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:33:27.658757 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-c7547d2c-2403-4590-9be8-81e725d5e470 req-1a73995d-bed9-4809-aadb-6762d8264183 tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:33:38.128002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-a99a4e3c-a5cb-49e1-91d7-aac263509561 req-82cb7bc0-0d88-4d99-8a32-72163de7c7f9 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:39.266123 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-a99a4e3c-a5cb-49e1-91d7-aac263509561 req-82cb7bc0-0d88-4d99-8a32-72163de7c7f9 tempest-TestVolumeBootPattern-1770467933 None] Create snapshot completed successfully
Oct 08 21:33:39.269278 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=21,cinder:DELETE=3,cinder:SELECT=59,cinder:INSERT=17 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:42.485220 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:33:42.521619 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (05343d6c-0209-45d6-b729-1107379b2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:42.528168 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fce005-b560-43a9-abb9-936dc6ac1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.545728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fce005-b560-43a9-abb9-936dc6ac1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:33:42Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd7b78ab-69e1-441b-b25b-3308b8b4050f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de1e3a16-a115-4874-8db9-d5fd7be5a555,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:33:42Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.551123 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09f92be-7fcc-49d8-a3c1-fe0e1bd9ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.556326 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09f92be-7fcc-49d8-a3c1-fe0e1bd9ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.564539 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfa75a-bbd5-4e11-b292-9ea448d839af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.568582 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfa75a-bbd5-4e11-b292-9ea448d839af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'volume_name': 'volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'volume_size': 1, 'snapshot_id': 'de1e3a16-a115-4874-8db9-d5fd7be5a555'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.573367 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aca330-7524-4294-9e90-ebf9c26771b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.577928 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aca330-7524-4294-9e90-ebf9c26771b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.582526 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f42487-5924-4e74-a5a5-de054d36f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.583612 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Volume bd7b78ab-69e1-441b-b25b-3308b8b4050f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'volume_size': 1, 'snapshot_id': 'de1e3a16-a115-4874-8db9-d5fd7be5a555'}
Oct 08 21:33:42.622596 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] cloning volumes/volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb@snapshot-de1e3a16-a115-4874-8db9-d5fd7be5a555 to volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:33:42.623261 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:42.718355 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:42.853499 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:33:42.853981 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:33:42.875794 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Marking volume bd7b78ab-69e1-441b-b25b-3308b8b4050f as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:33:42.883379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from snapshot de1e3a16-a115-4874-8db9-d5fd7be5a555 to bd7b78ab-69e1-441b-b25b-3308b8b4050f. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 08 21:33:42.916660 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f42487-5924-4e74-a5a5-de054d36f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'volume_size': 1, 'snapshot_id': 'de1e3a16-a115-4874-8db9-d5fd7be5a555'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.922070 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1704e328-5a87-44cb-813b-3df95604e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:33:42.931853 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f (bd7b78ab-69e1-441b-b25b-3308b8b4050f): created successfully
Oct 08 21:33:42.935802 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1704e328-5a87-44cb-813b-3df95604e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:33:42.942946 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (05343d6c-0209-45d6-b729-1107379b2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:33:42.955883 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-daf686db-16c4-4530-a8e3-4f0c2f035975 tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:33:45.774576 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-a4b02ee7-86cd-4719-8212-cf7cf614b4dd tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:33:46.598412 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-a4b02ee7-86cd-4719-8212-cf7cf614b4dd tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.823s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:33:46.599306 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-a4b02ee7-86cd-4719-8212-cf7cf614b4dd tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:33:46.625464 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-a4b02ee7-86cd-4719-8212-cf7cf614b4dd tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bd7b78ab-69e1-441b-b25b-3308b8b4050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '158317f7-ea34-423a-9aa3-0f639902e218'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:33:46.679722 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-10f46d91-5000-478a-8b3b-e8d13a31ac5a req-a4b02ee7-86cd-4719-8212-cf7cf614b4dd tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:33:53.295620 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e req-517fb948-dc77-4126-8a4f-1269f233d6db tempest-TestVolumeBackupRestore-199632938 None] Terminate volume connection completed successfully.
Oct 08 21:33:53.296276 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-c0a34183-9a63-4bca-8f70-b4bb81d2a19e req-517fb948-dc77-4126-8a4f-1269f233d6db tempest-TestVolumeBackupRestore-199632938 None] Deleting attachment 8600b9e6-773f-47bc-aed0-ed52b8a19e99. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:33:54.813615 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Acquiring lock "cinder-67154ed5-2fda-4ed4-9784-d919a9ecdfd3-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:54.828293 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-67154ed5-2fda-4ed4-9784-d919a9ecdfd3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:54.861844 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:55.265493 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Volume volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:33:55.281984 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] deleting rbd volume volume-67154ed5-2fda-4ed4-9784-d919a9ecdfd3 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:33:55.286862 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Acquiring lock "cinder-69230254-02a4-4b48-82bf-c2a70eba1591-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:55.298894 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-69230254-02a4-4b48-82bf-c2a70eba1591-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:55.337109 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:56.284647 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] deleting rbd volume volume-69230254-02a4-4b48-82bf-c2a70eba1591 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:33:56.329823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Created reservations ['5929d3a0-239c-4073-a203-b62f28163b51', 'b3c3742f-88da-4f22-9041-cc3d14696450', 'e5465e01-c3db-42d2-9ab3-983d00bd63e9', '0e6798cc-e329-4d77-b844-378350fbc41c'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:56.383686 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:56.434028 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:56.465232 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:56.468311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:33:56.506446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] deleting parent snapshot volume-69230254-02a4-4b48-82bf-c2a70eba1591.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:33:57.313279 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Deleted volume successfully.
Oct 08 21:33:57.338119 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-0067723c-c8af-4543-bbb0-8652a6369795 req-a674f9b7-fc62-4786-ac02-f66b5950cd66 tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:33:57.338530 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-0067723c-c8af-4543-bbb0-8652a6369795 req-a674f9b7-fc62-4786-ac02-f66b5950cd66 tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment 158317f7-ea34-423a-9aa3-0f639902e218. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:33:57.341830 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-f1ead7f0-71a2-4829-a46d-d06eb711db38 tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-67154ed5-2fda-4ed4-9784-d919a9ecdfd3-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:57.367799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Created reservations ['dd49fc07-9424-4a23-bdc9-d9a7628ad8aa', 'edffd033-602f-478e-8cdf-f296c718f447', 'e66d818b-729d-4f63-986e-cd69730d38fe', '19dda8f6-d12e-47db-b956-df8685875a24'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:57.381746 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=22,cinder:INSERT=13,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:57.422965 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:57.471286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:57.537939 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:57.543572 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-bd7b78ab-69e1-441b-b25b-3308b8b4050f-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:57.550332 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Deleted volume successfully.
Oct 08 21:33:57.561040 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-bd7b78ab-69e1-441b-b25b-3308b8b4050f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:57.579170 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-1271dfe5-ab4a-4db2-8cae-592647863699 tempest-TestVolumeBackupRestore-199632938 None] Lock "cinder-69230254-02a4-4b48-82bf-c2a70eba1591-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:57.604617 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:57.679312 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:33:57.684610 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-bd7b78ab-69e1-441b-b25b-3308b8b4050f {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:33:57.851700 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['9e515dd0-0211-4305-95a9-e874afc7955e', 'ae635092-1e49-4c4a-bfc1-a3dcf75c1f9f', 'c34a77b5-21c7-4994-adbb-469946cb4679', 'f3214aae-087c-4578-9306-b51dd2bd1f70'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:33:57.894209 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=63,cinder:UPDATE=23,cinder:INSERT=14 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:33:57.906416 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:57.938994 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:33:57.976829 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:33:57.983165 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:33:58.005008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-0067723c-c8af-4543-bbb0-8652a6369795 req-8f52b9fa-d23a-46ed-8eb5-9a9752d94f3d tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-bd7b78ab-69e1-441b-b25b-3308b8b4050f-delete_volume" released by "delete_volume" :: held 0.444s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:33:59.300777 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-de1e3a16-a115-4874-8db9-d5fd7be5a555-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:33:59.312688 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-de1e3a16-a115-4874-8db9-d5fd7be5a555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:33:59.314618 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:06.060140 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:34:06.061791 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:06.094660 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:06.124382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:34:29.436254 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:34:29.438014 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:34:29.481716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['5969101d-d27a-4bc2-b91f-87402fe9adea', '3b8c65db-5ce5-4e8b-bd20-eae3136b4d19', '5508ee33-2f70-4108-b8ca-bc63ec570c15', '368a41ec-82e9-4173-855f-4df6cb0634f2'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:34:29.521739 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] Delete snapshot completed successfully.
Oct 08 21:34:29.526102 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-9bdf24bf-f93f-4f25-a55c-881eb18f9e7f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-de1e3a16-a115-4874-8db9-d5fd7be5a555-delete_snapshot" released by "delete_snapshot" :: held 30.214s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:34:32.426680 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-e23ccc6b-7ea5-43e7-ad6a-cba56188cb9f tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:34:32.427318 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-e23ccc6b-7ea5-43e7-ad6a-cba56188cb9f tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment 19a616ad-acd1-4233-9ecc-6d0efc7d8e78. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:34:32.536356 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-40d2e48f-3ae3-4ed6-8694-d04a58635bfb-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:34:32.545332 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-40d2e48f-3ae3-4ed6-8694-d04a58635bfb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:34:32.579171 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:32.661319 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:34:32.667799 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:34:32.903930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:34:32.934079 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] deleting parent snapshot volume-40d2e48f-3ae3-4ed6-8694-d04a58635bfb.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:34:33.975112 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['ff052e39-8220-48ff-ba15-6f865c118632', 'f725a5fc-6e2d-4168-a851-2c91156801d3', '5eed9302-ee24-4d95-8268-059acd1d5ee9', '150ac122-042c-4c98-93a0-c0ef9bfda7e3'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:34:34.019051 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:34.042883 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:34.066789 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:34:34.071050 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:34:34.082720 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-8bc419f5-2a09-4388-8627-864bae25ece4 req-ec036857-be31-4900-8c29-0aee9161e4bb tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-40d2e48f-3ae3-4ed6-8694-d04a58635bfb-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:34:37.071784 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:34:37.092281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (47bb2aef-c116-45bd-8001-ea82f0748c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:34:37.098474 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2994209-4710-496b-8b84-34308de79c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.114690 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2994209-4710-496b-8b84-34308de79c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1655916489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=35b4d884-2f36-4b2a-b436-df821ca02419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:34:37Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.119698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f53796e-239c-45b3-ac70-5059cea4f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.123576 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f53796e-239c-45b3-ac70-5059cea4f777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.129014 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fe1a0f-08f7-4d62-afde-1789b5bd6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.206779 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fe1a0f-08f7-4d62-afde-1789b5bd6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35b4d884-2f36-4b2a-b436-df821ca02419', 'volume_name': 'volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236280>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.211629 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e1844a-fbf2-4dfb-ba7d-2cb58d81e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.215692 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e1844a-fbf2-4dfb-ba7d-2cb58d81e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.220164 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118033c5-3410-4ccd-a352-6f2481828a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.221282 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Volume 35b4d884-2f36-4b2a-b436-df821ca02419: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236280>}
Oct 08 21:34:37.221843 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Cloning 35b4d884-2f36-4b2a-b436-df821ca02419 from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 21:34:37.222581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:34:37.229948 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:34:37.241749 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 34, 37, 236656)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:34:37.242211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:34:37.242579 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 21:34:37.246473 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:34:37.247358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 21:34:37.253494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 21, 34, 37, 251226)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 21:34:37.253902 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 21:34:37.254290 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 21:34:37.265930 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:34:37.312487 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] creating snapshot='volume-35b4d884-2f36-4b2a-b436-df821ca02419.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 21:34:37.526475 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-35b4d884-2f36-4b2a-b436-df821ca02419.clone_snap' to 'volume-35b4d884-2f36-4b2a-b436-df821ca02419' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 21:34:37.632644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:34:37.633900 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:34:37.634263 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:34:37.647041 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 21:34:37.647662 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Marking volume 35b4d884-2f36-4b2a-b436-df821ca02419 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:34:37.655528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 35b4d884-2f36-4b2a-b436-df821ca02419. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 21:34:37.655859 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Creating volume glance metadata for volume 35b4d884-2f36-4b2a-b436-df821ca02419 backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 21:34:37.706731 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118033c5-3410-4ccd-a352-6f2481828a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b236280>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.711161 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d87e49d-f6cd-4a19-a09a-b6db28de6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:34:37.719798 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Volume volume-35b4d884-2f36-4b2a-b436-df821ca02419 (35b4d884-2f36-4b2a-b436-df821ca02419): created successfully
Oct 08 21:34:37.723215 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d87e49d-f6cd-4a19-a09a-b6db28de6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:34:37.728493 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (47bb2aef-c116-45bd-8001-ea82f0748c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:34:37.736209 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d9ca0e3c-39d6-4f0f-833d-420d1181502f tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:34:40.343443 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-568df2fd-57d5-4b6b-8047-577f62fe8341 req-caf474f9-01aa-4af8-af41-6628963f4217 tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:34:41.120426 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-568df2fd-57d5-4b6b-8047-577f62fe8341 req-caf474f9-01aa-4af8-af41-6628963f4217 tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.776s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:34:41.121172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-568df2fd-57d5-4b6b-8047-577f62fe8341 req-caf474f9-01aa-4af8-af41-6628963f4217 tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '35b4d884-2f36-4b2a-b436-df821ca02419', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:34:41.148182 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-568df2fd-57d5-4b6b-8047-577f62fe8341 req-caf474f9-01aa-4af8-af41-6628963f4217 tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35b4d884-2f36-4b2a-b436-df821ca02419', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8eb564dc-b191-44f4-b38d-ab5607d69daf'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:34:41.204361 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-568df2fd-57d5-4b6b-8047-577f62fe8341 req-caf474f9-01aa-4af8-af41-6628963f4217 tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:34:53.946953 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=51,cinder:INSERT=8,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:35:03.951586 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=54,cinder:INSERT=12,cinder:UPDATE=20 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:35:06.059827 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:35:06.060704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:35:06.087556 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:35:06.113372 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:35:23.949969 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:35:43.963582 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:35:53.962301 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:03.970255 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:06.059106 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:36:06.059754 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:36:06.083382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:36:06.106182 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:36:23.973831 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:33.978514 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:53.984416 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:53.985662 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:36:58.308316 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 req-e2a9b5ba-fe6e-4d23-95eb-83c840099f13 tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:36:58.309500 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-6fc5c572-3b24-425a-9fbf-f81c9ea5bca0 req-e2a9b5ba-fe6e-4d23-95eb-83c840099f13 tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment 8eb564dc-b191-44f4-b38d-ab5607d69daf. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:37:01.068629 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-4b045876-af20-4623-ab63-cd2f43bcf3f6 req-99426209-6f12-4ff1-92fc-26df8e53e32a tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:37:01.858209 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-4b045876-af20-4623-ab63-cd2f43bcf3f6 req-99426209-6f12-4ff1-92fc-26df8e53e32a tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.791s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:37:01.859026 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-4b045876-af20-4623-ab63-cd2f43bcf3f6 req-99426209-6f12-4ff1-92fc-26df8e53e32a tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '35b4d884-2f36-4b2a-b436-df821ca02419', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:37:01.886170 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-4b045876-af20-4623-ab63-cd2f43bcf3f6 req-99426209-6f12-4ff1-92fc-26df8e53e32a tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-35b4d884-2f36-4b2a-b436-df821ca02419', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35b4d884-2f36-4b2a-b436-df821ca02419', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8fe6abb5-7a5b-4167-b128-b546a2b86ca3'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:37:01.937090 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-4b045876-af20-4623-ab63-cd2f43bcf3f6 req-99426209-6f12-4ff1-92fc-26df8e53e32a tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:37:06.062864 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:37:06.064274 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:37:06.090132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:37:06.113305 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:37:13.991802 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:37:24.002023 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=19,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:37:44.002138 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:37:44.003386 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:38:06.062219 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:38:06.062965 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:38:06.086781 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:38:06.113036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:38:14.038910 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:38:14.039668 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:38:44.023929 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:38:51.576415 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:38:51.605370 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-aa12cc38-acce-428a-b09d-b9dbc0536043 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:38:52.560283 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-aa12cc38-acce-428a-b09d-b9dbc0536043 tempest-TestVolumeBootPattern-1770467933 None] Create snapshot completed successfully
Oct 08 21:38:53.010702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:38:53.040501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (e3e9f6c3-e70a-40d8-bdee-104722e45de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:38:53.046681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e862165-7baa-45d4-a48b-664422f917c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.062350 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e862165-7baa-45d4-a48b-664422f917c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1180588431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=65306e30-518e-4a44-99d2-d9613008ad70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d9857e88402494e964f2099de5bb60c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fcd2528-668f-458e-b610-fd1376ee5dd0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:38:53Z,use_quota=True,user_id='7ac4eff18a664804af16cf21321f9290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.067388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f22fef2-5b3b-4440-a8c9-4f16737d269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.071304 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f22fef2-5b3b-4440-a8c9-4f16737d269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.076111 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5346cf32-d5af-4caa-9f2b-65ea0b358fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.080268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5346cf32-d5af-4caa-9f2b-65ea0b358fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '65306e30-518e-4a44-99d2-d9613008ad70', 'volume_name': 'volume-65306e30-518e-4a44-99d2-d9613008ad70', 'volume_size': 1, 'snapshot_id': '1fcd2528-668f-458e-b610-fd1376ee5dd0'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.085396 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4edcdff-a8be-4efb-8afc-cd2801c8038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.089101 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4edcdff-a8be-4efb-8afc-cd2801c8038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.094286 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578f86f-b677-48b8-b80e-2da466d05cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.095575 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Volume 65306e30-518e-4a44-99d2-d9613008ad70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-65306e30-518e-4a44-99d2-d9613008ad70', 'volume_size': 1, 'snapshot_id': '1fcd2528-668f-458e-b610-fd1376ee5dd0'}
Oct 08 21:38:53.119994 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] cloning volumes/volume-35b4d884-2f36-4b2a-b436-df821ca02419@snapshot-1fcd2528-668f-458e-b610-fd1376ee5dd0 to volume-65306e30-518e-4a44-99d2-d9613008ad70 {{(pid=133344) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 08 21:38:53.120624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:38:53.178566 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:38:53.287892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:38:53.288200 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:38:53.311256 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Marking volume 65306e30-518e-4a44-99d2-d9613008ad70 as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 21:38:53.316263 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Copying metadata from snapshot 1fcd2528-668f-458e-b610-fd1376ee5dd0 to 65306e30-518e-4a44-99d2-d9613008ad70. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 08 21:38:53.349945 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1578f86f-b677-48b8-b80e-2da466d05cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65306e30-518e-4a44-99d2-d9613008ad70', 'volume_size': 1, 'snapshot_id': '1fcd2528-668f-458e-b610-fd1376ee5dd0'}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.354388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130603d7-9a9d-4b97-ad55-aeec807ba523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:38:53.362310 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Volume volume-65306e30-518e-4a44-99d2-d9613008ad70 (65306e30-518e-4a44-99d2-d9613008ad70): created successfully
Oct 08 21:38:53.365645 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130603d7-9a9d-4b97-ad55-aeec807ba523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:38:53.370897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Flow 'volume_create_manager' (e3e9f6c3-e70a-40d8-bdee-104722e45de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:38:53.382807 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-b7c91678-e04e-45ad-af49-1919d813c036 tempest-TestVolumeBootPattern-1770467933 None] Created volume successfully.
Oct 08 21:38:57.212758 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1f35b2ff-0deb-441c-b45a-78238cc391d6 req-6d8f84a1-e8c3-4b18-a212-399b340b3089 tempest-TestVolumeBootPattern-1770467933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:38:57.977799 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-1f35b2ff-0deb-441c-b45a-78238cc391d6 req-6d8f84a1-e8c3-4b18-a212-399b340b3089 tempest-TestVolumeBootPattern-1770467933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:38:57.978644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1f35b2ff-0deb-441c-b45a-78238cc391d6 req-6d8f84a1-e8c3-4b18-a212-399b340b3089 tempest-TestVolumeBootPattern-1770467933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-65306e30-518e-4a44-99d2-d9613008ad70', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '65306e30-518e-4a44-99d2-d9613008ad70', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:38:58.006971 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-1f35b2ff-0deb-441c-b45a-78238cc391d6 req-6d8f84a1-e8c3-4b18-a212-399b340b3089 tempest-TestVolumeBootPattern-1770467933 None] Connection info returned from driver {'name': 'volumes/volume-65306e30-518e-4a44-99d2-d9613008ad70', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '65306e30-518e-4a44-99d2-d9613008ad70', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3700fc6f-ec4a-4dd6-b9ee-06e6f5bfe63b'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:38:58.059336 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-1f35b2ff-0deb-441c-b45a-78238cc391d6 req-6d8f84a1-e8c3-4b18-a212-399b340b3089 tempest-TestVolumeBootPattern-1770467933 None] attachment_update completed successfully.
Oct 08 21:39:06.058304 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:39:06.059214 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:39:06.086246 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:39:06.109378 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:39:14.027577 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=28,cinder:UPDATE=4,cinder:INSERT=14,cinder:DELETE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:39:24.036694 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=41,cinder:INSERT=10,cinder:UPDATE=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:39:54.039506 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:40:04.039251 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:40:06.054950 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:40:06.055732 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:40:06.088594 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:40:06.115027 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:40:24.048457 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:40:34.056662 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:40:52.107179 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-6d4e2768-d2e6-4651-be09-479567de294e req-bd4a84a6-5745-4605-aa2d-f76c24cd255b tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:40:52.107870 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-6d4e2768-d2e6-4651-be09-479567de294e req-bd4a84a6-5745-4605-aa2d-f76c24cd255b tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment 3700fc6f-ec4a-4dd6-b9ee-06e6f5bfe63b. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:40:53.529620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-65306e30-518e-4a44-99d2-d9613008ad70-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:40:53.539669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-65306e30-518e-4a44-99d2-d9613008ad70-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:40:53.571457 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:40:53.640976 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:40:53.647435 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-65306e30-518e-4a44-99d2-d9613008ad70 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:40:53.843294 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['d7867c97-406c-465e-99b0-3c0f7026e009', '0b1f6574-b68c-45c9-880e-d2765b616dc8', '50b18cba-c15f-40e7-aa73-191e6d520d9c', '13ede070-e2d4-4a8a-8954-1cc48a492fa2'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:40:53.887017 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:40:53.910528 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:40:53.935502 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:40:53.939735 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:40:53.951432 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d3531eae-bd45-4fa4-85d9-24cab3b12332 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-65306e30-518e-4a44-99d2-d9613008ad70-delete_volume" released by "delete_volume" :: held 0.412s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:40:54.057898 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=22,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:40:54.665595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-1fcd2528-668f-458e-b610-fd1376ee5dd0-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:40:54.683624 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-1fcd2528-668f-458e-b610-fd1376ee5dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:40:54.687004 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:04.067261 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:41:06.060106 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:41:06.060749 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:06.083239 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:06.104420 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:41:14.067165 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:41:24.835422 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['e7328101-4125-4ef6-a458-380f984157d0', '6810cfab-0d54-42ee-9a25-2dfc3861ce02', 'ed3588a9-64e4-4ffc-9e4c-d5de514ff3bb', '2d2b5162-464e-4758-ab2e-c441e707d132'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:41:24.873895 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] Delete snapshot completed successfully.
Oct 08 21:41:24.878139 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-93fb2466-ba36-45d9-adda-bfdaa159f020 tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-1fcd2528-668f-458e-b610-fd1376ee5dd0-delete_snapshot" released by "delete_snapshot" :: held 30.195s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:41:28.629380 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-8b439759-44d8-4e38-b79e-07652eee1f9b req-ba6097a7-6cfb-4cdb-af64-e08c0cb46772 tempest-TestVolumeBootPattern-1770467933 None] Terminate volume connection completed successfully.
Oct 08 21:41:28.630019 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-8b439759-44d8-4e38-b79e-07652eee1f9b req-ba6097a7-6cfb-4cdb-af64-e08c0cb46772 tempest-TestVolumeBootPattern-1770467933 None] Deleting attachment 8fe6abb5-7a5b-4167-b128-b546a2b86ca3. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:41:30.647002 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Acquiring lock "cinder-35b4d884-2f36-4b2a-b436-df821ca02419-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:41:30.655133 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-35b4d884-2f36-4b2a-b436-df821ca02419-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:41:30.687966 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:30.746611 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:41:30.752264 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] deleting rbd volume volume-35b4d884-2f36-4b2a-b436-df821ca02419 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:41:30.933176 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 21:41:30.960692 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] deleting parent snapshot volume-35b4d884-2f36-4b2a-b436-df821ca02419.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 21:41:31.344595 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Created reservations ['a9625dd2-c159-4611-9de1-6c08bd7d0161', '3d9d88ee-2fb9-4c0f-8830-9a545f35051b', '5ffca313-5b99-4f66-9cc6-74d46cb4f79d', 'b8289b72-90ae-4c61-8a58-2a4fc55e569b'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:41:31.389519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:31.412763 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:41:31.437202 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:41:31.441396 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Deleted volume successfully.
Oct 08 21:41:31.453546 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c89689e0-4b5d-4b8a-ac82-cde7e577b09d tempest-TestVolumeBootPattern-1770467933 None] Lock "cinder-35b4d884-2f36-4b2a-b436-df821ca02419-delete_volume" released by "delete_volume" :: held 0.798s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:41:44.071608 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=29,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:41:44.077755 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:41:54.087429 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:42:06.059289 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:42:06.060097 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:42:06.097558 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:42:06.127326 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:42:24.084872 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:42:44.078690 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:42:54.088390 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:43:04.089585 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:43:06.063244 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:43:06.063927 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:43:06.088892 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:43:06.115943 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:43:34.091983 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:43:44.099340 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:43:54.102191 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:44:06.060814 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:44:06.061526 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:44:06.087359 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:44:06.119454 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:44:14.097281 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:44:34.104527 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:44:44.113904 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:44:54.115282 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:45:14.124047 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:45:34.115520 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:45:44.119234 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:45:54.128642 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:46:06.065624 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:46:06.066379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:46:06.104615 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:46:06.131092 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:46:14.135385 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:46:34.138712 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:46:44.148787 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:47:04.149487 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:47:06.066310 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:47:06.067226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:47:06.090324 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:47:06.113685 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:47:14.160700 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:47:34.160899 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:47:34.164492 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:47:54.171954 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:48:04.177135 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:48:06.068744 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:48:06.069450 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:48:06.092564 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:48:06.115891 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:48:14.186917 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:48:34.184577 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:48:34.188129 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:48:44.193432 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:49:04.195257 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:49:06.070516 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:49:06.071188 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:49:06.094137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:49:06.117228 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:49:14.203803 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:49:22.254417 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:49:22.274980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Flow 'volume_create_manager' (8d3f7cbe-442a-4cd7-b645-ce24e94ded0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:49:22.282879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25772d55-6420-4a66-80e5-7b15d96e713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.298716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25772d55-6420-4a66-80e5-7b15d96e713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-125456998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9a80439-6df2-422f-8a08-47768518e62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3718dd3e536649b5bf1970ff06ddea69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:49:22Z,use_quota=True,user_id='5e838176b44c4f23b470cfc152f79990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.303883 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e8478c-0237-4d05-a6f5-bd12f495a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.308032 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e8478c-0237-4d05-a6f5-bd12f495a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.312921 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48d6971-4675-4792-8217-05599236e792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.317132 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48d6971-4675-4792-8217-05599236e792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'volume_name': 'volume-d9a80439-6df2-422f-8a08-47768518e62c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.322398 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d468fe7-a120-45dd-9e37-712e59d95087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.326205 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d468fe7-a120-45dd-9e37-712e59d95087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.330742 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f19b762-971a-41d9-8d92-09e86b4b3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.331793 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Volume d9a80439-6df2-422f-8a08-47768518e62c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a80439-6df2-422f-8a08-47768518e62c', 'volume_size': 1}
Oct 08 21:49:22.332184 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] creating volume 'volume-d9a80439-6df2-422f-8a08-47768518e62c' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:49:22.332940 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:49:22.378869 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:49:22.379281 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:49:22.383449 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f19b762-971a-41d9-8d92-09e86b4b3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a80439-6df2-422f-8a08-47768518e62c', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.387826 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd56f00-0b91-4c00-ba39-e03e869d3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:49:22.397230 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Volume volume-d9a80439-6df2-422f-8a08-47768518e62c (d9a80439-6df2-422f-8a08-47768518e62c): created successfully
Oct 08 21:49:22.401631 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd56f00-0b91-4c00-ba39-e03e869d3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:49:22.407108 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Flow 'volume_create_manager' (8d3f7cbe-442a-4cd7-b645-ce24e94ded0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:49:22.414582 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-a48ed7b4-0506-434a-b85f-92472432175f tempest-ServerActionsTestJSON-775805645 None] Created volume successfully.
Oct 08 21:49:24.124909 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-89fd5ccb-ba33-42da-a00b-47216a8c9efd req-3c8b170e-018a-4262-b57c-34c79bb4aa5b tempest-ServerActionsTestJSON-775805645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:49:24.944116 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-89fd5ccb-ba33-42da-a00b-47216a8c9efd req-3c8b170e-018a-4262-b57c-34c79bb4aa5b tempest-ServerActionsTestJSON-775805645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.819s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:49:24.944754 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-89fd5ccb-ba33-42da-a00b-47216a8c9efd req-3c8b170e-018a-4262-b57c-34c79bb4aa5b tempest-ServerActionsTestJSON-775805645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:49:24.967107 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-89fd5ccb-ba33-42da-a00b-47216a8c9efd req-3c8b170e-018a-4262-b57c-34c79bb4aa5b tempest-ServerActionsTestJSON-775805645 None] Connection info returned from driver {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94a25003-af30-440c-a454-f7c95a936f3c'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:49:25.014468 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-89fd5ccb-ba33-42da-a00b-47216a8c9efd req-3c8b170e-018a-4262-b57c-34c79bb4aa5b tempest-ServerActionsTestJSON-775805645 None] attachment_update completed successfully.
Oct 08 21:49:34.212383 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:49:41.610990 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-f30d04a8-3549-471b-98cf-ec49fbcb3a02 tempest-ServerActionsTestJSON-775805645 None] Terminate volume connection completed successfully.
Oct 08 21:49:41.611637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-f30d04a8-3549-471b-98cf-ec49fbcb3a02 tempest-ServerActionsTestJSON-775805645 None] Deleting attachment 94a25003-af30-440c-a454-f7c95a936f3c. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:49:43.617271 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-24963091-a928-49fa-bcce-21460787606c tempest-ServerActionsTestJSON-775805645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:49:44.214539 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:49:44.349063 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-24963091-a928-49fa-bcce-21460787606c tempest-ServerActionsTestJSON-775805645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.732s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:49:44.350000 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-24963091-a928-49fa-bcce-21460787606c tempest-ServerActionsTestJSON-775805645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:49:44.371644 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-24963091-a928-49fa-bcce-21460787606c tempest-ServerActionsTestJSON-775805645 None] Connection info returned from driver {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9f2e5b2d-7277-4ff8-ab66-d9885ec2a57c'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:49:44.424004 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-ccbbf63f-9347-49e5-9cde-dff212524ec8 req-24963091-a928-49fa-bcce-21460787606c tempest-ServerActionsTestJSON-775805645 None] attachment_update completed successfully.
Oct 08 21:49:51.105039 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-53f6c0f5-06a1-475b-b2b4-dca46df182a8 tempest-ServerActionsTestJSON-775805645 None] Terminate volume connection completed successfully.
Oct 08 21:49:51.105728 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-53f6c0f5-06a1-475b-b2b4-dca46df182a8 tempest-ServerActionsTestJSON-775805645 None] Deleting attachment 9f2e5b2d-7277-4ff8-ab66-d9885ec2a57c. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:49:53.817854 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-e9bb797f-a1d7-451b-a912-9f31d6bcbc99 tempest-ServerActionsTestJSON-775805645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:49:54.545465 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-e9bb797f-a1d7-451b-a912-9f31d6bcbc99 tempest-ServerActionsTestJSON-775805645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.727s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:49:54.546213 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-e9bb797f-a1d7-451b-a912-9f31d6bcbc99 tempest-ServerActionsTestJSON-775805645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:49:54.568676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-e9bb797f-a1d7-451b-a912-9f31d6bcbc99 tempest-ServerActionsTestJSON-775805645 None] Connection info returned from driver {'name': 'volumes/volume-d9a80439-6df2-422f-8a08-47768518e62c', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9a80439-6df2-422f-8a08-47768518e62c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe15a701-e26e-49c6-844b-e016a6916013'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:49:54.615634 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-d3a35e4d-a731-45a2-a24e-10130467d817 req-e9bb797f-a1d7-451b-a912-9f31d6bcbc99 tempest-ServerActionsTestJSON-775805645 None] attachment_update completed successfully.
Oct 08 21:50:01.031849 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-023dd351-694b-4e4e-acf4-790d779614eb req-bbc33f73-77c5-4775-802a-f7e3cbd6b96a tempest-ServerActionsTestJSON-775805645 None] Terminate volume connection completed successfully.
Oct 08 21:50:01.032554 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-023dd351-694b-4e4e-acf4-790d779614eb req-bbc33f73-77c5-4775-802a-f7e3cbd6b96a tempest-ServerActionsTestJSON-775805645 None] Deleting attachment fe15a701-e26e-49c6-844b-e016a6916013. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:50:02.236267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Acquiring lock "cinder-d9a80439-6df2-422f-8a08-47768518e62c-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:50:02.245718 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Lock "cinder-d9a80439-6df2-422f-8a08-47768518e62c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:50:02.284633 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:50:02.324235 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:50:02.324762 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Volume volume-d9a80439-6df2-422f-8a08-47768518e62c is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:50:02.329316 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] deleting rbd volume volume-d9a80439-6df2-422f-8a08-47768518e62c {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:50:02.487817 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Created reservations ['01088ebb-1ec0-431c-852d-101ec06b8eb4', '3bea1829-4420-41b8-ad7c-1b526f205e11', '8521c617-f4da-4c02-8221-533b5edd4ec0', '7466ecd4-7288-4232-b061-a7c48eadf3c4'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:50:02.533484 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:50:02.558008 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:50:02.582675 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:50:02.587142 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Deleted volume successfully.
Oct 08 21:50:02.598711 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-916b3d81-3ff9-42fb-95d2-e17c893edada tempest-ServerActionsTestJSON-775805645 None] Lock "cinder-d9a80439-6df2-422f-8a08-47768518e62c-delete_volume" released by "delete_volume" :: held 0.353s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:50:06.072401 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:50:06.073072 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:50:06.103962 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:50:06.133244 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:50:14.210273 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=27,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:50:14.211923 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=55,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:50:34.214382 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:50:44.218575 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:51:04.236625 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:51:06.071534 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:51:06.072211 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:51:06.136269 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:51:06.184048 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:51:14.213799 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:51:24.220011 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:51:42.290371 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:51:42.313545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Flow 'volume_create_manager' (6fece471-bd72-43d0-9275-a59da94e981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:51:42.320637 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5580a00-b856-447c-bfe3-0f646c2daea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.337254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5580a00-b856-447c-bfe3-0f646c2daea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-740738193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e43bda1c-c18a-48a3-81f9-12a65dd43532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c1dbcc78cc4349b68eb40eb879be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:51:42Z,use_quota=True,user_id='80a96d23b9a84b03a0549f1d57be4779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.342484 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e92d45-036a-4521-9376-58036a8af6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.346679 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e92d45-036a-4521-9376-58036a8af6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.351684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0350c300-f610-4b58-85ac-f24ebbc6afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.355598 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0350c300-f610-4b58-85ac-f24ebbc6afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43bda1c-c18a-48a3-81f9-12a65dd43532', 'volume_name': 'volume-e43bda1c-c18a-48a3-81f9-12a65dd43532', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.360231 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e914a9-3a33-4d5b-af63-11a970d1e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.364075 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e914a9-3a33-4d5b-af63-11a970d1e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.368520 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce38842-d980-46bf-bbd4-214e67ec167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.369598 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Volume e43bda1c-c18a-48a3-81f9-12a65dd43532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43bda1c-c18a-48a3-81f9-12a65dd43532', 'volume_size': 1}
Oct 08 21:51:42.369988 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] creating volume 'volume-e43bda1c-c18a-48a3-81f9-12a65dd43532' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:51:42.370754 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:51:42.500865 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:51:42.501276 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:51:42.505335 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce38842-d980-46bf-bbd4-214e67ec167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43bda1c-c18a-48a3-81f9-12a65dd43532', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.509685 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1bc31f-deef-44fd-bb9e-a3f3ced101aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:51:42.518380 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Volume volume-e43bda1c-c18a-48a3-81f9-12a65dd43532 (e43bda1c-c18a-48a3-81f9-12a65dd43532): created successfully
Oct 08 21:51:42.522565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1bc31f-deef-44fd-bb9e-a3f3ced101aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:51:42.527961 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Flow 'volume_create_manager' (6fece471-bd72-43d0-9275-a59da94e981a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:51:42.535613 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-e1f4defd-d93a-4fba-9ae0-02327d32713d tempest-TestMinimumBasicScenario-734937097 None] Created volume successfully.
Oct 08 21:51:43.904453 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 req-923ae4e0-e94c-442f-8f65-e126cc1d6115 tempest-TestMinimumBasicScenario-734937097 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:51:44.226865 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:51:44.908052 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 req-923ae4e0-e94c-442f-8f65-e126cc1d6115 tempest-TestMinimumBasicScenario-734937097 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.004s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:51:44.908802 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 req-923ae4e0-e94c-442f-8f65-e126cc1d6115 tempest-TestMinimumBasicScenario-734937097 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e43bda1c-c18a-48a3-81f9-12a65dd43532', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': 'e43bda1c-c18a-48a3-81f9-12a65dd43532', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:51:44.930596 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 req-923ae4e0-e94c-442f-8f65-e126cc1d6115 tempest-TestMinimumBasicScenario-734937097 None] Connection info returned from driver {'name': 'volumes/volume-e43bda1c-c18a-48a3-81f9-12a65dd43532', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e43bda1c-c18a-48a3-81f9-12a65dd43532', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6c86127-4d24-476e-9098-ad22d0bbf928'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:51:44.981880 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-5667dd56-e0a5-4f29-9f12-a19eedec9c61 req-923ae4e0-e94c-442f-8f65-e126cc1d6115 tempest-TestMinimumBasicScenario-734937097 None] attachment_update completed successfully.
Oct 08 21:51:47.241374 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-999692dc-678d-4e39-aa15-65b43d015967 tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:51:48.138933 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-999692dc-678d-4e39-aa15-65b43d015967 tempest-TestMinimumBasicScenario-734937097 None] Create snapshot completed successfully
Oct 08 21:52:04.229633 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:52:06.070017 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:52:06.070684 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:52:06.093638 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:52:06.117063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:52:24.225829 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=25,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:52:44.240766 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:52:54.240064 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:53:06.071856 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:53:06.072676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:53:06.095937 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:53:06.118980 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:53:14.246813 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:53:34.253988 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:53:39.988620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] Acquiring lock "cinder-d22073b2-8d8f-4ce6-8d90-b878031904f7-delete_snapshot" by "delete_snapshot" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:53:39.998823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-d22073b2-8d8f-4ce6-8d90-b878031904f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:53:40.000277 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:53:44.257804 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:54:04.266068 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:54:06.074235 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:54:06.074897 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:54:06.102716 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:54:06.124082 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:54:10.129515 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] Created reservations ['107385c1-1967-4e3e-b722-6bf52bacd503', 'a176e80f-e945-46a1-9e9c-065d5889a6b1', '8cba2296-e7a5-41b9-93db-e9cf443c31f7', '6e2fb549-ead6-45c4-8dfe-fa78ebfe9c13'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:54:10.163674 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] Delete snapshot completed successfully.
Oct 08 21:54:10.168404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-95f7be43-c4c8-47f1-b5a1-a3132889eed4 tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-d22073b2-8d8f-4ce6-8d90-b878031904f7-delete_snapshot" released by "delete_snapshot" :: held 30.170s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:54:14.276245 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:54:34.278334 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:54:44.286199 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:55:06.079200 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:55:06.080252 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:55:06.107866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:55:06.130705 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:55:14.290592 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:55:14.298069 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:55:29.823259 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-67c06a0d-1a2e-4297-8382-ec62455e8c47 req-a8fd50cc-7c05-4e5c-9946-bdcda83ec3a4 tempest-TestMinimumBasicScenario-734937097 None] Terminate volume connection completed successfully.
Oct 08 21:55:29.823803 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-67c06a0d-1a2e-4297-8382-ec62455e8c47 req-a8fd50cc-7c05-4e5c-9946-bdcda83ec3a4 tempest-TestMinimumBasicScenario-734937097 None] Deleting attachment f6c86127-4d24-476e-9098-ad22d0bbf928. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:55:30.367268 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Acquiring lock "cinder-e43bda1c-c18a-48a3-81f9-12a65dd43532-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:55:30.380154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-e43bda1c-c18a-48a3-81f9-12a65dd43532-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:55:30.423310 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:55:30.464477 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:55:30.464934 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Volume volume-e43bda1c-c18a-48a3-81f9-12a65dd43532 is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:55:30.470565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] deleting rbd volume volume-e43bda1c-c18a-48a3-81f9-12a65dd43532 {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:55:30.668602 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Created reservations ['9950ad47-3658-44fe-98d6-b3fc5c412eea', '6a4b6201-6c13-4f10-8fbd-58d9076503c1', 'b782f6b6-e2d0-4e64-9aea-398279792693', 'e71a0f3e-1a9d-4825-a86d-18707ee3df66'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:55:30.711506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:55:30.736062 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:55:30.759354 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:55:30.764915 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Deleted volume successfully.
Oct 08 21:55:30.776681 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-d2ff281b-4288-4af7-bad9-34e5583d2f0a tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-e43bda1c-c18a-48a3-81f9-12a65dd43532-delete_volume" released by "delete_volume" :: held 0.397s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:55:44.306600 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=11,cinder:SELECT=20,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:55:44.307272 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:56:04.307542 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:56:04.556288 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 21:56:04.575916 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Flow 'volume_create_manager' (4fc4d855-e88d-49ad-9948-53dc59b2c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:56:04.582665 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f482632-e798-4cb9-babb-f8ecea8afd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.599702 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f482632-e798-4cb9-babb-f8ecea8afd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T21:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-515133841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c1dbcc78cc4349b68eb40eb879be88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T21:56:05Z,use_quota=True,user_id='80a96d23b9a84b03a0549f1d57be4779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.604789 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b278e9-3332-408b-8180-4a4ac820664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.609466 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b278e9-3332-408b-8180-4a4ac820664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.614284 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345ca6e0-0e76-422d-99ce-3447cedc12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.618154 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345ca6e0-0e76-422d-99ce-3447cedc12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'volume_name': 'volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.622810 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2338d157-e444-4a18-957f-23f935522825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.626527 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2338d157-e444-4a18-957f-23f935522825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.630926 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bb5bbf-b7f7-45f2-af89-44420a2aa298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.631958 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Volume 0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'volume_size': 1}
Oct 08 21:56:04.632325 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] creating volume 'volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf' {{(pid=133344) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 08 21:56:04.633064 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:56:04.695024 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 21:56:04.695403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 21:56:04.699029 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bb5bbf-b7f7-45f2-af89-44420a2aa298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'volume_size': 1}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.703459 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf42cfe-4f9b-4451-b321-35f1b7474572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 21:56:04.712280 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Volume volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf (0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf): created successfully
Oct 08 21:56:04.716267 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf42cfe-4f9b-4451-b321-35f1b7474572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 21:56:04.721501 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Flow 'volume_create_manager' (4fc4d855-e88d-49ad-9948-53dc59b2c881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 21:56:04.729052 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-46375174-e0c1-4ebe-8389-b7ef4f70c91d tempest-TestMinimumBasicScenario-734937097 None] Created volume successfully.
Oct 08 21:56:06.076393 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:56:06.077049 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:56:06.103506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:56:06.132352 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:56:06.154625 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb req-75a2a5c2-196f-4a3d-93c5-2e9f43a1996c tempest-TestMinimumBasicScenario-734937097 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 21:56:06.977833 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb req-75a2a5c2-196f-4a3d-93c5-2e9f43a1996c tempest-TestMinimumBasicScenario-734937097 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.823s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 21:56:06.978691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb req-75a2a5c2-196f-4a3d-93c5-2e9f43a1996c tempest-TestMinimumBasicScenario-734937097 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 21:56:07.003376 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb req-75a2a5c2-196f-4a3d-93c5-2e9f43a1996c tempest-TestMinimumBasicScenario-734937097 None] Connection info returned from driver {'name': 'volumes/volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0800f00f-0dca-4e92-9dc6-d2e5f0237faf'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 21:56:07.051974 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-82fcd140-496b-4ed1-8fa2-f0bf99955ceb req-75a2a5c2-196f-4a3d-93c5-2e9f43a1996c tempest-TestMinimumBasicScenario-734937097 None] attachment_update completed successfully.
Oct 08 21:56:24.307597 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=9,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:56:24.310561 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:56:44.318987 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:56:54.323467 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:57:06.077768 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:57:06.078629 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:57:06.104634 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:57:06.132627 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:57:14.332076 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:57:14.333731 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:57:22.495339 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee req-9b3b9f44-188f-43ae-9801-56c3c331783a tempest-TestMinimumBasicScenario-734937097 None] Terminate volume connection completed successfully.
Oct 08 21:57:22.495988 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-6c89aa03-8f27-4a3c-ab17-0c453a1685ee req-9b3b9f44-188f-43ae-9801-56c3c331783a tempest-TestMinimumBasicScenario-734937097 None] Deleting attachment 0800f00f-0dca-4e92-9dc6-d2e5f0237faf. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 21:57:23.117860 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Acquiring lock "cinder-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 21:57:23.128565 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 21:57:23.167301 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:57:23.203725 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 21:57:23.204173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Volume volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 21:57:23.208669 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] deleting rbd volume volume-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 21:57:23.368269 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Created reservations ['10e6302f-43dc-4390-990d-c7f2a9c9efec', 'd2d0eef6-488f-4823-8e0e-189d584f721d', '08e336c2-c43b-4ed1-b246-63600be78e23', '96c8bcb7-cbea-4017-ad65-2f23c224dd52'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 21:57:23.414129 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:57:23.437991 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:57:23.462146 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:57:23.466221 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Deleted volume successfully.
Oct 08 21:57:23.477978 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-bc320933-2eec-4ba9-a293-a4c4a5d2c0ce tempest-TestMinimumBasicScenario-734937097 None] Lock "cinder-0dff6fc1-abc9-4ff3-8bc4-2f1726cfbfaf-delete_volume" released by "delete_volume" :: held 0.349s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 21:57:34.331383 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:57:54.331342 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:58:04.344875 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:58:06.077266 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:58:06.077933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:58:06.102946 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:58:06.127260 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:58:34.348673 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:58:34.354431 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:58:54.347960 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:59:06.082538 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 21:59:06.083251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:59:06.106846 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 21:59:06.132823 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 21:59:14.355512 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:59:24.360149 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:59:44.368753 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 21:59:54.374085 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:00:06.087732 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:00:06.088389 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:00:06.111866 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:00:06.134519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:00:14.380357 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:00:24.385243 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:00:34.395493 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:01:04.390352 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:01:06.089931 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:01:06.090639 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:01:06.113782 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:01:06.136713 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:01:14.394941 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:01:34.403285 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:01:44.407475 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:02:04.417452 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:02:06.092009 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:02:06.093698 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:02:06.116349 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:02:06.140063 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:02:14.418587 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:02:34.427137 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:02:54.442144 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:03:04.444719 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:03:06.094975 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:03:06.095640 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:03:06.119186 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:03:06.141690 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:03:24.446357 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:03:34.455606 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:03:54.457321 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:04:04.466416 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:04:06.096604 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:04:06.097336 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:04:06.132858 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:04:06.166942 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:04:34.470201 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:04:34.477404 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:04:54.469615 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:05:04.473072 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:05:06.102699 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:05:06.103407 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:05:06.131140 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:05:06.156519 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:05:14.483609 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:05:44.477507 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:05:44.478578 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:06:06.102665 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:06:06.103358 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:06:06.127540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:06:06.150999 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:06:14.481038 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:06:14.490117 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:06:54.488056 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:06:54.489867 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:07:06.106395 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:07:06.107051 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:07:06.130348 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:07:06.154768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:07:14.493339 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:07:34.491739 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:07:44.497710 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:08:04.504534 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:08:06.109767 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:08:06.110604 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:08:06.154036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:08:06.192036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:08:24.508488 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:08:34.516040 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:08:54.517701 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:08:54.519405 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:09:06.107802 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:09:06.108555 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:09:06.132133 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:09:06.155446 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:09:14.516947 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:09:24.528255 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:09:42.365767 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 08 22:09:42.385367 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Flow 'volume_create_manager' (af459abb-5a4b-4568-89b9-8a8c97b6c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 22:09:42.391607 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c50e47-e32b-4ad0-a822-b7ead9e4fcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:42.408829 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c50e47-e32b-4ad0-a822-b7ead9e4fcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-08T22:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2003695867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a4c2867-d278-4fbe-92da-e4f35447373a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c33d4041764691b1ad69f9f1abe60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-08T22:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-08T22:09:42Z,use_quota=True,user_id='199e2426220e4cc4b1d37d4075e67cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e86e7727-83c5-4750-ab26-4096887cb782),volume_type_id=e86e7727-83c5-4750-ab26-4096887cb782)' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:42.414016 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffe629-5549-4c17-b464-295c01281935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:42.417967 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffe629-5549-4c17-b464-295c01281935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:42.422810 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503bc94e-c253-4e04-bbe9-2dc0ba148a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:42.503101 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503bc94e-c253-4e04-bbe9-2dc0ba148a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a4c2867-d278-4fbe-92da-e4f35447373a', 'volume_name': 'volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b0b3c10>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:42.508379 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc853cc6-bd1d-4362-8f26-19868f5e2780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:42.512199 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc853cc6-bd1d-4362-8f26-19868f5e2780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:42.516706 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b1ef5c-5f96-453c-8813-e7b9ade37b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:42.517836 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Volume 4a4c2867-d278-4fbe-92da-e4f35447373a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b0b3c10>}
Oct 08 22:09:42.518403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Cloning 4a4c2867-d278-4fbe-92da-e4f35447373a from image c508bd7f-7db9-4b2c-af7c-be54a855c355  at location (None, None). {{(pid=133344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 08 22:09:42.519152 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Acquiring lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" by "_prepare_image_cache_entry" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 22:09:42.528173 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 22:09:42.537704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 22, 9, 42, 532468)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 22:09:42.538172 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 22:09:42.538581 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Found cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 08 22:09:42.548044 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Lock "cinder-c508bd7f-7db9-4b2c-af7c-be54a855c355" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 22:09:42.549251 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Attempting to retrieve cache entry for image = c508bd7f-7db9-4b2c-af7c-be54a855c355 on host ncdv-master-1@ceph#ceph. {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 08 22:09:42.555404 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'volume_id': '75bc1a74-4c1d-4a8b-bacf-00463fd6604f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34), 'last_used': datetime.datetime(2022, 10, 8, 22, 9, 42, 553141)}. {{(pid=133344) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 08 22:09:42.555812 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.image.cache [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Image-volume cache entry image_update_at = 2022-10-08 20:42:34+00:00, requested image updated_at = 2022-10-08 20:42:34+00:00. {{(pid=133344) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 08 22:09:42.556197 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Creating from source image-volume 75bc1a74-4c1d-4a8b-bacf-00463fd6604f {{(pid=133344) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 08 22:09:42.568507 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:09:42.620531 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] creating snapshot='volume-4a4c2867-d278-4fbe-92da-e4f35447373a.clone_snap' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 08 22:09:42.870445 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] cloning 'volume-75bc1a74-4c1d-4a8b-bacf-00463fd6604f@volume-4a4c2867-d278-4fbe-92da-e4f35447373a.clone_snap' to 'volume-4a4c2867-d278-4fbe-92da-e4f35447373a' {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 08 22:09:42.978036 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Volume volume-b4f8dd99-28cb-4d51-a8bd-a9fed1cd3f21.deleted is not a clone. {{(pid=133344) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 08 22:09:42.979437 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 08 22:09:42.979822 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133344) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 08 22:09:42.993676 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] clone created successfully {{(pid=133344) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 08 22:09:42.994307 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.volume_utils [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Marking volume 4a4c2867-d278-4fbe-92da-e4f35447373a as bootable. {{(pid=133344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 08 22:09:43.002137 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Copying metadata from image c508bd7f-7db9-4b2c-af7c-be54a855c355 to 4a4c2867-d278-4fbe-92da-e4f35447373a. {{(pid=133344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 08 22:09:43.002569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Creating volume glance metadata for volume 4a4c2867-d278-4fbe-92da-e4f35447373a backed by image c508bd7f-7db9-4b2c-af7c-be54a855c355 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 08 22:09:43.054691 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b1ef5c-5f96-453c-8813-e7b9ade37b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'volume_size': 1, 'image_id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8cbdca763b15498ebcee722600237097', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c508bd7f-7db9-4b2c-af7c-be54a855c355', 'created_at': datetime.datetime(2022, 10, 8, 20, 42, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 8, 20, 42, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c508bd7f-7db9-4b2c-af7c-be54a855c355/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f8b3b0b3c10>}' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:43.059103 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be9efab-21b0-4216-b816-a7cb38cd64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 08 22:09:43.067231 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.flows.manager.create_volume [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Volume volume-4a4c2867-d278-4fbe-92da-e4f35447373a (4a4c2867-d278-4fbe-92da-e4f35447373a): created successfully
Oct 08 22:09:43.070571 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be9efab-21b0-4216-b816-a7cb38cd64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133344) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 08 22:09:43.075771 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Flow 'volume_create_manager' (af459abb-5a4b-4568-89b9-8a8c97b6c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133344) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 08 22:09:43.082868 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [None req-c3b95249-038e-4889-9ffe-2e8060689311 tempest-TestShelveInstance-1230879253 None] Created volume successfully.
Oct 08 22:09:44.536076 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=8,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:09:45.368641 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-5c812225-f487-47d4-b5c6-167f836b7121 req-15dbebfe-7af4-48dd-b48a-1781c435f94c tempest-TestShelveInstance-1230879253 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 22:09:46.156132 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-5c812225-f487-47d4-b5c6-167f836b7121 req-15dbebfe-7af4-48dd-b48a-1781c435f94c tempest-TestShelveInstance-1230879253 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.787s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 22:09:46.156982 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-5c812225-f487-47d4-b5c6-167f836b7121 req-15dbebfe-7af4-48dd-b48a-1781c435f94c tempest-TestShelveInstance-1230879253 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '4a4c2867-d278-4fbe-92da-e4f35447373a', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 22:09:46.182790 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-5c812225-f487-47d4-b5c6-167f836b7121 req-15dbebfe-7af4-48dd-b48a-1781c435f94c tempest-TestShelveInstance-1230879253 None] Connection info returned from driver {'name': 'volumes/volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4a4c2867-d278-4fbe-92da-e4f35447373a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '72c259e4-8ec0-4c80-b068-4f8493275864'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 22:09:46.232429 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-5c812225-f487-47d4-b5c6-167f836b7121 req-15dbebfe-7af4-48dd-b48a-1781c435f94c tempest-TestShelveInstance-1230879253 None] attachment_update completed successfully.
Oct 08 22:09:54.539837 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=33,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:10:06.110363 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:10:06.111226 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:10:06.136816 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:10:06.160795 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:10:14.541479 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:10:24.545900 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:10:34.554129 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:10:54.564149 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:11:04.567534 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:11:06.106985 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:11:06.107711 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:11:06.130835 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:11:06.154540 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:11:24.572398 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:11:24.574697 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:11:44.575305 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:11:54.583407 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:12:06.108884 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:12:06.109693 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:12:06.132482 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:12:06.155964 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:12:14.594377 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:12:16.844088 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-51c98378-4da9-4df6-800c-da523affb28b req-7ae3a8e1-dcf0-4406-86f2-b7ac84762a84 tempest-TestShelveInstance-1230879253 None] Terminate volume connection completed successfully.
Oct 08 22:12:16.844709 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-51c98378-4da9-4df6-800c-da523affb28b req-7ae3a8e1-dcf0-4406-86f2-b7ac84762a84 tempest-TestShelveInstance-1230879253 None] Deleting attachment 72c259e4-8ec0-4c80-b068-4f8493275864. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 22:12:18.577227 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-053217c7-ad79-4cb8-988e-6ccfc30667ee req-c38a3abd-6c5d-44a0-ba22-0a6078847ad1 tempest-TestShelveInstance-1230879253 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 08 22:12:19.307663 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_concurrency.processutils [req-053217c7-ad79-4cb8-988e-6ccfc30667ee req-c38a3abd-6c5d-44a0-ba22-0a6078847ad1 tempest-TestShelveInstance-1230879253 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.730s {{(pid=133344) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 08 22:12:19.308485 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-053217c7-ad79-4cb8-988e-6ccfc30667ee req-c38a3abd-6c5d-44a0-ba22-0a6078847ad1 tempest-TestShelveInstance-1230879253 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c9c4111a-33bb-48a0-bf2e-c5ba7e9c6756', 'volume_id': '4a4c2867-d278-4fbe-92da-e4f35447373a', 'discard': True}} {{(pid=133344) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 08 22:12:19.331970 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-053217c7-ad79-4cb8-988e-6ccfc30667ee req-c38a3abd-6c5d-44a0-ba22-0a6078847ad1 tempest-TestShelveInstance-1230879253 None] Connection info returned from driver {'name': 'volumes/volume-4a4c2867-d278-4fbe-92da-e4f35447373a', 'hosts': ['10.222.0.26'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4a4c2867-d278-4fbe-92da-e4f35447373a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '803dd410-c21c-4006-a90a-0d0cc7c08f96'} {{(pid=133344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 08 22:12:19.381521 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-053217c7-ad79-4cb8-988e-6ccfc30667ee req-c38a3abd-6c5d-44a0-ba22-0a6078847ad1 tempest-TestShelveInstance-1230879253 None] attachment_update completed successfully.
Oct 08 22:12:24.594600 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=20,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:12:44.595179 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:04.598349 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:04.601119 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:06.111341 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:13:06.112495 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:13:06.138403 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:13:06.161768 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:13:24.608633 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:44.618806 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:54.623346 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:13:54.770800 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-1da7899e-973c-4021-b99e-190c43fecdfe req-d78bc705-98dc-4f01-85ba-410ba6418699 tempest-TestShelveInstance-1230879253 None] Terminate volume connection completed successfully.
Oct 08 22:13:54.771216 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.manager [req-1da7899e-973c-4021-b99e-190c43fecdfe req-d78bc705-98dc-4f01-85ba-410ba6418699 tempest-TestShelveInstance-1230879253 None] Deleting attachment 803dd410-c21c-4006-a90a-0d0cc7c08f96. {{(pid=133344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 08 22:13:54.879561 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Acquiring lock "cinder-4a4c2867-d278-4fbe-92da-e4f35447373a-delete_volume" by "delete_volume" {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 08 22:13:54.889388 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Lock "cinder-4a4c2867-d278-4fbe-92da-e4f35447373a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 08 22:13:54.927802 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:13:54.997254 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] volume has no backup snaps {{(pid=133344) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 08 22:13:55.003898 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] deleting rbd volume volume-4a4c2867-d278-4fbe-92da-e4f35447373a {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 08 22:13:55.203081 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] volume is a clone so cleaning references {{(pid=133344) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 08 22:13:55.239549 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] deleting parent snapshot volume-4a4c2867-d278-4fbe-92da-e4f35447373a.clone_snap {{(pid=133344) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 08 22:13:55.816073 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.quota [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Created reservations ['681d8fa4-8b4a-479e-8435-6e9789fc5250', 'bbcd5f62-a689-41c9-8735-cb1c796df2f9', 'a8eeaa11-9e21-48de-a38e-9911e3f505a3', '1515435e-5865-452c-9139-bb355ef52b3e'] {{(pid=133344) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 08 22:13:55.859012 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:13:55.882559 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:13:55.907321 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:13:55.911510 ncdv-master-1 cinder-volume[133344]: INFO cinder.volume.manager [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Deleted volume successfully.
Oct 08 22:13:55.923938 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.coordination [req-1da7899e-973c-4021-b99e-190c43fecdfe req-8d742d10-a9a6-4c47-bb9e-7ec5989324fb tempest-TestShelveInstance-1230879253 None] Lock "cinder-4a4c2867-d278-4fbe-92da-e4f35447373a-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=133344) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 08 22:14:06.116636 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:14:06.118592 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:14:06.154245 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:14:06.201311 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:14:14.633406 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:14:34.630622 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:14:54.637615 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:15:04.641425 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:15:06.120889 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:15:06.121599 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:15:06.145449 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:15:06.169933 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:15:24.649077 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:15:44.658822 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:15:54.663990 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:16:06.124242 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:16:06.124917 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:16:06.148174 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:16:06.174879 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:16:14.665381 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:16:14.668799 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:16:44.676584 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:16:44.679619 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:17:04.676209 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:17:06.130034 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:17:06.130721 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:17:06.153494 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:17:06.176686 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:17:24.688954 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:17:34.687961 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:17:44.696420 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:18:04.700616 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:18:06.131924 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:18:06.132620 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:18:06.155382 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:18:06.178909 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:18:14.705159 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:18:34.717440 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:18:54.713654 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:19:06.134556 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:19:06.135257 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:19:06.160773 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:19:06.185314 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:19:14.713764 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:19:24.723231 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:19:44.724067 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:19:54.733517 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:20:04.735758 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:20:06.131672 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:20:06.132320 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:20:06.155706 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:20:06.178545 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:20:14.741455 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:20:34.745358 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:20:44.754050 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:20:54.755971 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:21:06.134061 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:21:06.134704 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:21:06.158170 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:21:06.183155 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:21:14.766003 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:21:34.771951 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:21:44.775218 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:22:04.784510 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:22:06.137943 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:22:06.138630 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:22:06.162569 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:22:06.185364 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:22:14.792629 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:22:34.794238 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:22:54.795411 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:23:06.140109 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:23:06.140856 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:23:06.164814 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:23:06.187506 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:23:14.802020 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:23:24.810853 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:23:44.815137 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:23:44.816607 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:24:04.827729 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:24:06.142112 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:24:06.142745 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:24:06.165514 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:24:06.199889 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:24:24.834034 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:24:34.836550 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:24:54.837685 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:25:04.842054 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:25:06.145197 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:25:06.145861 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:25:06.169005 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:25:06.191949 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:25:24.850218 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:25:44.858986 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:25:54.860526 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:26:06.147608 ncdv-master-1 cinder-volume[133344]: DEBUG oslo_service.periodic_task [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133344) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 08 22:26:06.148259 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:26:06.171418 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.volume.drivers.rbd [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133344) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 08 22:26:06.194429 ncdv-master-1 cinder-volume[133344]: DEBUG cinder.manager [None req-a88f4c80-9f24-4c9c-a1a9-9c574a6d1ce0 None None] Notifying Schedulers of capabilities ... {{(pid=133344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 08 22:26:14.870985 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:26:14.872413 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:26:34.870103 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=1 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 08 22:26:44.880067 ncdv-master-1 cinder-volume[133344]: DEBUG dbcounter [-] [133344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}